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ABSTRACT 


s' 

Thia  paper  concerns  a  generalization  o£  finite  automata,  the  "tree 
acceptors,"  which  have  as  their  Inputs  finite  trees  of  symbols  rather  than 
the  usual  sequences  of  symbols.  Ordinary  finite  automata  prove  to  be  special 
cases  of  tree  acceptors,  and  many  of  the  results  of  finite  automata  theory 
continue  to  hold  In  their  appropriately  generalized  forms.  The  tree  acceptors 
provide  new  characterizations  of  the  classes  of  regular  sets  and  of  context- 
free  languages.  The  theory  of  tree  acceptors  Is  applied  to  a  decision  problem 
of  mathematical  logic.  It  is  shown  here  that  the  weak  second-order  theory  of 
two  successors  is  decidable,  thus  settling  a  problem  of  Buchi.  This  result  Is 
in  turn  applied  to  obtain  positive  solutions  to  the  decision  problems  for 
various  other  theories, e.g.  the  weak  second-order  theories  of  order  types  built 
up  from  the  finite  types,  u>,  and  7|  (the  type  of  the  rationale)  by  finitely  many 
applications  of  the  operations  of  order  type  addition,  multiplication,  and 
converse;  and  the  weak  second-order  theory  of  locally  free  algebras  with  only 
unary  operations. 
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TREE  ACCEPTORS  AND  SOME  OF  THEIR  APPLICATIONS* 


INTRODUCTION 

This  paper  concerns  a  generalization  of  a  part  of  finite  automata  theory. 

We  shall  define  a  generalized  finite  automaton,  called  a  "tree  acceptor," 
which  has  as  its  inputs  finite  trees  of  symbols  instead  of  the  usual  sequences 
of  symbols.  Ordinary  finite  automata  prove  to  be  special  cases  of  tree 
acceptors.  It  turns  out  that  many  of  the  results  of  finite  automata  theory 
remain  valid  in  their  appropriately  generalized  forms. 

v 

Section  1  Includes  the  definitions  of  trees  and  tree  acceptors,  and  the 

"  A 

development  of  some  of  their  basic  properties.  The  properties  of  the  sets  of 
trees  accepted  by  tree  acceptors  are  investigated  and  an  alternative  characteriza¬ 
tion  of  those  sets  is  obtained.  An  application  of  the  results  in  Seetion  ~1  to 
the  theory  of  context-free  languages  is  given  in-Oectlon  2.  In  Section  3;  we 
give  a  positive  solution  to  a  problem  of  Buchl  {!]:  Is  the  weak  second-order 
theory  of  two  successors  decidable?  Applications  of  this  result  to  decision 
problems  of  weak  second-order  loglc^  appear  ln-Saction  4;  for  example,  we  show 
that  the  class  of  order  types  with  decidable  weak  second-order  theories  contains 
u),  every  finite  type,  and  the  type  of  ratlonals,  and  is  closed  under  the  order- 
type  operations  of  addition,  multiplication,  and  converse.  Finally  in  Section  5, 

Research  sponsored  in  part  by  the  Air  Force  Cambridge  Research  Laboratories, 
Office  of  Aerospf.ee  Rc  ch,  USAF,  under  Contract  FI962867COOO8,  and  by  the 
Air  Force  Office  ofScienniic  Research,  Office  of  Aerospace  Research,  USAF, 
under  AFOSR  Grant  No.  AF-AF0SR-1203-67 . 
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a  result  of  Buchl  [2]  and  Che  generalised  products  of  Fefenaan  and  Vaught  are 
utilised  to  extend  the  decidability  result  of  Section  3  to  a  more  general 
case:  the  weak  second-order  theory  of  locally  free  algebras  with  only  unary 
operations . 

Many  of  the  results  In  Sections  1  and  3  of  this  paper  were  also  obtained 
by  J.W.  Thatcher  and  J.B.  Wright  [28],  who  use  a  different,  but  essentially 
equivalent,  formulation  of  generalised  automata.  In  fact,  Thatcher  and  Wright 
were  very  close  to  obtaining  the  decision  result  In  Section  3  when  they  were 
notified  by  Addison  (personal  communication)  of  the  present  author's  success. 
The  characterisation  of  context-free  languages  given  In  Section  2  Is  basically 
that  given  by  J.  Mesel  and  J.B.  Wright  [19];  In  a  different  formulation. 

The  author  wishes  to  thank  Professors  J.W.  Addison  and  Alfred  Tarski  for 
many  stimulating  discussions  and  useful  suggestions. 

PRELIMINARIES 

We  shall  employ  standard  set- theoretical  notions:  0,  U,  €,  ate.  A  —  B 
denotes  the  difference  of  the  sets  A,  B,  i.e.,  A  —  B  ■  [x:  x  £  A  and  x  $  B}. 
Bach  ordinal  number  is  defined  as  the  set  of  all  smaller  ordinals;  0,  the  first 
ordinal,  is  equal  to  the  empty  set  0.  Thus,  the  <  relation  among  ordinals 
coincides  with  the  membership  relation  £.  Finite  ordinals  0,  1,  2,  ...  are 
called  natural  numbers  and  the  set  of  all  of  them  is  the  first  finite  ordinal 
(D.  Cardinals  are  initial  ordinals,  l.e.,  ordinals  not  set- theoretically 
equivalent  to  smaller  ordinals.  The  cardinality  of  a  set  A  Is  denoted  by  A. 
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If  a  function  f  is  defined  for  each  element  of  a  class  K  and  A  £  K,  then 
f(A)  ■  [f(x)  :  x  f  A}.  The  domain  of  a  function  f  is  denoted  by  dom(f). 
Assertions  of  the  form  "C  is  the  class  defined  by  the  conditions...11  or  "C 
is  the  least  class  such  that..."  are  to  be  interpreted  to  mean  that  C  is  the 
intersection  of  all  classes  satisfying  the  stated  conditions. 

Our  notation  for  automata,  words,  languages,  etc.,  is,  for  the  most  part, 
adapted  from  [21]  and  [14].  An  alphabet  £  is  a  nonempty  finite  set  of  symbols 
(or  letters ) .  Unless  otherwise  stated,  the  letters  Z,  A,  rt,  £',  A1;  •••  will 
denote  alphabets.  A  word  over  Z,  or  simply  a  word  when  Z  is  understood,  is  a 
finite  sequence  of  elements  of  Z.  A  word  with  only  one  letter  a  is  identified 
with  a  itself;  6  denotes  the  empty  word,  and  concatenation  of  words  is  indicated 
by  juxtaposition.  (To  facilitate  the  use  of  these  conventions,  we  implicitly 
rule  out  various  "pathological"  cases,  e.g.,  we  do  not  admit  e  as  a  possible 
element  of  an  alphabet.)  Usually,  the  small  greek  letters  c,  ?,  p,,  v  are  used 
for  single  elements  of  an  alphabet,  and  small  Roman  letters  u,v,w,x,y,a  for  words 
over  an  alphabet.  The  length  of  a  word  w  is  denoted  by  |  w|  .  If  A,  B  are  sets 
of  wordy  then  A  *  B  ■  [xy  :  x  £  A  and  y  £  B).  A°  ■  {e},  and  for  each  finite 
n,  An+*  ■  An  •  A;  the  union  ^  An  is  denoted  by  A*.  In  particular,  if  A 

■ft 

is  an  alphabet,  then  A  is  the  set  of  all  words  over  A. 

A  set  of  words  A  is  regular  If  for  some  alphabet  Z,  A  is  a  member  of  the 

ft 

last  class  C  such  that:  (i)  every  finite  subset  of  Z  belongs  to  C>  (ii)  C 

is  a  Boolean  algebra  of  sets  (i.e.,  if  X,  Y  £  C,  then  XHY,  X|JY,  X— Y  are 

also  members  of  C),  ( 111 )  if  X,  Y  £  G,  then  X  *  Y  £  C,  and  (iv)  if  X  £  C,  then 
* 

X  £  C. 
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If  L  1«  an  alphabet,  then  a  ^-automaton  la  a  4- tuple  tl  ■  <S,t,sQ,D)  where 
S  la  a  nonempty  finite  set  (of  states),  t  la  a  mapping  of  S  X  I  Into  S  (the 
tranaition  function),  sq  £  S  (the  Initial  stata),  and  DCS  (the  designated 
states).  We  associate  with  91  the  function  t,  defined  recursively:  t(c)  ■  sq, 
and  for  any  w  €  L  and  a  €  £>  t(w<j)  ■  t(t(w),o).  91  accepts  a  word  w  €  L  If 

t(w)  £  D;  T(ll)  denotes  the  set  of  words  accepted  by  91.  We  note  the  well-known 
result  of  Kleene: 

A  set  of  words  A  Is  regular  If  and  only  if  A  ■  T(tl) 
for  some  Automaton  91. 

Throughout  this  paper  we  accept  as  given  a  fixed  infinite  list  of  distinct 
letters  e^,  a^  ...  .  The  alphabets  {sq,  ...,ap},  p  <  u),  will  play  a  special  role. 
The  symbols  a0,a^,a2  will  also  be  denoted  by  a,  b,  c  respectively. 
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SECTION  1.  TREE  ACCEPTORS  AMD  RECOGNIZABLE  SETS 

DEFINITION  1.1.  A  E-tree,  or  a  traa  over  E,  of  ordtr  p,  p  >  0,  1*  a  function 

# 

t  :  A  -*  I  where  A  la  a  finite  subset  of  {ao, . .  .,0^}  closed  under  the  Initial 
segment  relation  (l.e.,  If  uv  6  A,  then  u  €  A). 

The  email  Greek  letters  t,  tt,  p,  t',...  will  be  used  for  trees.  We  adopt 
the  following  special  notation  for  trees:  The  value  of  a  tree  rata  word 
w  f  dom(r)  may  be  denoted  by  as  well  as  t(w). 

Figure  1  presents  graphic  representations  of  two  trees  over  the  alphabet 
In  each  of  the  diagrams,  the  value  of  the  tree  at  c  appears  at  the 

apex;  below  and  to  the  left  of  the  apex  Is  the  value  at  a,  below  and  to  the 

right  of  this,  the  value  at  b,  etc.  Thus  Figure  1(a)  Is  a  diagram  of  the  tree 

t  where  t£  •  o,  t  ■  u,  ■  n,  T#b  •  5,  Tb  •  v,  ■  4,  and  t  Is  undefined 

elsewhere.  The  trees  in  Figures  1(a)  and  1(b)  are  of  orders  2  and  3  respectively. 


v 


1(b) 


Figure  1.  Two  Trees  Over  the  Alphabet  {o,g,ii,v}. 
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The  clese  of  ell  £-traes  of  e  given  order  p  will  be  denoted  by  £*;  when 
we  uee  this  notation,  the  number  p  will  always  be  either  determined  by  the 
context  or  understood  to  be  arbitrary.  In  most  of  this  section,  we  shall 
restrict  our  consideration  to  trees  of  order  2,  l.e.,  trees  which  are  functions 
with  domains  which  are  finite  subsets  of  (a,b}  .  This  Is  done  am  rely  for 
notatlonal  convenience;  and,  usually,  the  reader  will  easily  be  able  to  supply 
the  rather  obvious  modifications  to  our  definitions,  theorems,  and  proofs  which 
are  required  for  the  transition  from  order  2  to  any  finite  order  p.  Following 
Theorem  1.16,  we  shall  make  some  further  reaarka  concerning  the  relationships 
between  sets  of  trees  of  various  orders. 

The  empty  tree,  l.e.,  the  function  with  domain  0,  Is  denoted  by  a*  A 
convention  of  considerable  convenience  which  we  shall  adopt  Is  the  following: 
for  any  tree  t  and  word  w,  we  write  Ty  ■  €  if  and  only  If  w  {  dom(T).  Thus, 

A  could  be  defined  as  the  unique  tree  satisfying  the  equation  ■  c.  If 
o  €  E*  we  Identify  the  £-tree  t  such  that  t€  ■  a  and  ■  c  for  all  w  t  c  with 
the  symbol  a  Itself  (of  course,  a  Is  also  Identified  with  the  one  letter  word 
o;  nevertheless,  no  confusion  will  result  from  these  conventions). 

A  terminal  of  a  tree  t  is  a  word  w  6  dom(T)  such  that  no  extension  of  w  is 

also  In  dorn(T).  The  set  of  all  terminals  of  t  Is  called  the  frontier  of  t, 

denoted  by  fr(T).  The  "subtree  of  t  beginning  at  w"  Is  t^w.  Formally,  If  t 

Is  a  £-tree  and  w  €  2  ,  then  i^w  is  the  £-tree  it  such  that  tt  ■  t  for  each 
* 

€{a,b}  .  It  r,  t'  are  £-trees,  then  t[w/t]  Is  the  result  of  replacing  the 
subtree  of  t  beginning  at  w  with  the  tree  t',  l.e.,  t[w/t']  Is  the  function  n 


such  that 
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for  all  v  6 

nu  “  Tu  £or  *11  U  €  (Cw)«{a,b}#). 

Node*  that  t[w/t']  la  a  I-traa  only  in  cast  v  €  {ua,  ub  :  uc  dom(r))u  {e }. 

For  a  €  E  and  t,  t'  f  I#,  vt  put  o[t,t']  ■  (a[a/r])  [b/T1].  Thua  o[t,t']  la 
tl"  unlqua  traa  n  auch  that  n£  ■  a,  n^a  ■  t,  and  n^b  *  r*  •  Evary  traa  axcapt 
A  can  ba  axpraaaad  In  tha  fora  o[t,t']  for  some  a,  r,  t' . 

The  notation  o[t,t']  facllltatea  a  form  of  proof  which  we  call  "tree 
Induction";  namely,  if  for  a  given  propoaltlon  P(t),  where  r  ranges  over  £-trees, 
ve  can  prove 

(I)  P(A) 

(II)  if  P(t)  and  P(t'  ),  then  P(a[T,T'])  for  every  o  £  L, 

then  we  Infer  P(t)  for  every  t  €  L* .  Corresponding  to  the  principle  of  tree 
Induction  la  a  form  of  definition,  "tree  recursion." 

The  depth  of  a  tree  t  is  ||  t  ||  ■  1  +  n,  where  n  la  the  length  of  the  longest 
word  In  the  domain  of  t.  An  alternative  definition  of  depth  la  by  tree 
recursion: 

II  A  ||  -  0 

||ct[t,t']  ||  ■  1  +  max( ||t||,  ||t* ||) . 

Proofs  by  tree  induction  are,  of  course,  simply  inductions  on  depth;  a  similar 
remark  applies  to  definitions  by  tree  recursion. 
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The  concept  'E-tree"  may  be  regarded  as  generalising  the  concept  'E-word." 

The  practice  of  defining  sequences  as  functions  of  a  special  kind  is  common  in 
mathematics;  when  we  construe  a  E-word  as  a  function  with  range  £  and  with  domain 
a  finite  set  consisting  of  all  initial  segments  of  some  words  in  {a}  ,  the 
generalisation  to  £-trees  becomes  obvious. 

Other  representations  of  trees  than  the  one  we  have  given  in  Definition  1.1 
are  more  comoon  in  the  literature.  Salient  among  these  is  the  definition  of  a 
tree  as  a  partial  ordering  satisfying  certain  conditions.  This  definition  does 
not  lend  Itself  to  our  purposes,  since  we  wish  to  maintain  the  distinction 
between  left-  and  right -branching. 

Another  approach,  quite  equivalent  to  ours,  but  which  we  prefer  not  to 
adopt  here,  represents  trees  as  terms  in  a  formal  language:  The  elements  of  £ 
are  construed  as  2-place  function  symbols  (or  p-place  function  symbols  for  trees 
of  order  p)  and  a  new  symbol,  X,  which  serves  as  a  constant,  is  introduced. 

The  empty  tree  A  is  represented  by  the  term  X,  and  for  any  a  6  £  and  t, 
t'  €  & >  If  if,  V  are  the  terms  representing  t,  t'  respectively,  then  <j(if,  f') 
is  the  term  representing  o[t,t'].  Thus,  the  tree  in  Figure  1(a)  is  represented 
by  the  term 

(1)  a(n(n(X,X),  S(X,\)),  v(X,n(X,X))). 

(Notice  that  the  notations  we  have  adopted  enable  us,  in  effect,  to  sometimes 
make  use  of  the  "term  representation  of  trees";  in  line  (1),  we  have  only  to 
replace  the  round  parentheses  (,  )  by  brackets  [,  ]  and  the  symbol  X  by  A  to 
obtain  a  correct  expression  for  a  tree  of  Figure  1(a).) 
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The  representation  of  trees  as  terms  in  a  formal  language  has  Its  advantages 
In  certain  contexts.  It  is  essentially  the  approach  used  by  Thatcher  and  Wright 
in  [28]-— their  "generalized  finite  automata"  have  terms  as  inputs,  and  using 
these,  they  obtain  many  results  closely  related  or  identical  to  those  which 
appear  in  Sections  1  and  3  of  this  paper. 

Most  of  the  remainder  of  this  section  will  be  devoted  to  the  development  of 
a  generalized  notion  of  finite  state  acceptors,  or  finite  automata,  which  admits 
trees  rather  than  words  as  their  inputs.  It  turns  out  that  a  large  part  of 
conventional  finite  automata  theory  continues  to  hold  in  the  generalized  context. 
Thus,  our  general  approach  and  most  of  the  theorems  and  proofs  in  this  section 
(and  in  Section  3  as  well)  are  rather  natural  adaptations  of  material  found  in 
the  literature  on  finite  automata.  We  are  particularly  indebted  to  Rabin  and 
Scott  [21],  and  to  Elgot  [10].  Occasionally  when  a  proof  la  very  similar  to  its 
corresponding  version  in  one  of  these  papers,  we  will  merely  sketch  it  or  omit 
it  entirely. 

DEFINITION  1.2.  A  E-tree  acceptor  is  a  4-tuple  31  ■  (S,t,sQ,D)  where 

(i)  S  is  a  nonempty  finite  set  (of  states); 

(ii)  t  is  a  mapping  of  S  x  S  x  Z  into  S  (the  transition  function): 

(iii)  f  S  (the  initial  state); 

(iv)  DcS  (the  set  of  designated  states). 

Associated  with  81  is  the  function  t  :  L#  -*  S  defined  by 

t(A)  -  »0, 

t(o[T,T'])  -  t(t”( t),  t(t'),  a), 
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for  all  a  €  2  and  t,  t'  £  1^.  11  accepts  a  tree  t  £  ifr  if  t(T)  f  D.  T(9l) 

denotes  the  set  of  Z-trees  accepted  by  91. 

DEFINITION  1.3 »  Let  V  ■  <S,t,so,D)  be  u  Z-tree  acceptor  and  let  t  €  Z^.  The 
S-tree  tt  incompatible  with  t  (or  simply  compatible  with  t  when  II  is  understood) 
is  defined  by 

(i)  dom( tt)  -  fe}  U  (dom(r)  •  (a,b}), 

(ii)  ttw  ■  f(r|^w)  for  each  w  f  dom(n). 

The  tree  tt  compatible  with  t  might  also  be  called  the  state  tree  of  t. 
Notice  that  ||tt||  •  1  +  !|t||.  This  is  analogous  to  the  situation  with  finite 
automata,  where  a  sequence  of  states  compatible  with  an  input  word  is  always 
one  term  longer  than  the  word. 

LEMMA  1.4.  If  H  ■  (S,t,ao,D)  is  a  Z-tree  acceptor,  t  c  Z^,  and  tt  is  compatible 
with  t,  then  t  €  T(W)  if  and  only  if  tt^  £  D. 

DEFINITION  1.5  A  set  A  c  Z^  is  recognizab le  (over  Z)  if  A  •  T(1I)  for  some 
Z-tree  acceptor  II.  * 

LEMMA  1.6.  If  Z^,  Z2  are  alphabets  and  Z^  £  Zg,  then  a  set  A  c  Z^  is  recogni¬ 
zable  over  Z^  if  and  only  if  A  is  recognizable  over  Zg. 

THEOREM  1.7.  The  class  of  recognizable  sets  is  a  Boolean  algebra;  l.e.,  it  is 
closed  under  finite  unions,  finite  intersections,  and  differences. 


*The  term  recognizable  was  Introduced  by  Mezei  and  Wright  in  [  19]  • 
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PROOF.  Let  A,  B  be  two  recognizable  sets;  In  view  of  1.6,  we  may  assume  that 
they  have  a  common  underlying  alphabet  Z.  Let  SI  ■  (S,t,sQ,D)  and 
IB  *  (S',t' ,s^,D' >  be  Z-tree  acceptors  such  that  T(8l)  ■  A  and  T(8)  ■  B.  We 
shall  construct  acceptors  E,  E'  E"  such  that  T(E)  “  A  U  B,  T(E')  “  A  D  B, 
and  T(E")  “  A  —  B.  Let 

E  -  <S  X  S',r,<8(),s'>,E> 

where 

r(<s1^s[>,<s2,sp,a)  -  (tCs^s^a),  t' (sJ,s£,cj)  > 

for  all  s^,  s2  £  S,  sj,  s^  f  S',  a  €  2,  and  E»S  xD'  U  D  *  S' .  The  acceptors 
E',  G"  are  obtained  from  E  be  replacing  E  by  D  x  D'  and  D  X  (s'  ~  D'), 
respectively.  It  is  easy  to  verify  (e.g.,  by  tree  induction)  that  E,  E',  E" 
possess  the  desired  properties. 

Note  that  in  the  proof  of  Theorem  1.7,  the  construction  of  E,  E',  E' '  from 
the  given  acceptors  SI,  8  is  effective. 

The  concept  of  "nondeterainistic  automata"  has  proved  useful  in  finite 
automata  theory;  although  nondeterainistic  automata  are  equivalent  to  ordinary 
automata  with  respect  to  sets  of  words  accepted,  they  nevertheless  are  often 
considerably  more  convenient  to  use  in  the  course  of  proofs.  An  entirely 
analogous  situation  exists  in  the  context  of  tree  acceptors. 

DEFINITION  1.8.  A  nondeterainistic  Z-tree  acceptor  is  a  4- tuple  SI  -  <S,t,I,D> 
where 


(i)  S  is  a  nonempty  finite  set  (of  states) ; 
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(11)  t  Is  a  mapping  of  S  x  S  x  I  Into  the  nonempty  subsets  of  S  (the 
transition  function) ; 

(ill)  I  Is  a  nonempty  subset  of  S  (the  initial  states): 

(lv)  DCS  (the  subset  of  designated  states). 

When  it  is  necessary  to  emphasize  the  distinction,  we  shall  refer  to  the 
tree  acceptors  of  Definition  1.1  as  deterministic  tree  acceptors. 


DEFINITION  1.9«  Let  SI  ■  (S,t,I,D>  be  a  nondeterministic  2-tree  acceptor. 

The  relation  of  compatibility  between  2-trees  and  S-trees  is  defined  by  the 
following  two  conditions  (i)  if  s  €  I,  then  8  is  compatible  with  A;  (ii)  if 
tt,  it'  are  compatible  with  t,  t'  respectively,  and  if  a  £  2  and  s  £  t(TT_,TV,a), 


then  s  [tt,tt']  is  compatible  with  ct[t,t'].  SI  accepts  a  tree  t  €  L'r  if  there 
exists  an  S-tree  tt  compatible  with  t  such  that  Tr£  €  D.  T(SI)  denotes  the  set  of 
2-trees  accepted  by  SI. 


Just  as  with  finite  automata,  it  turns  out  that  the  class  of  sets  accepted 
by  nondeterministic  tree  acceptors  is  the  same  as  the  class  of  sets  accepted  by 
deterministic  tree  acceptors,  namely,  the  recognizable  sets.  Specifically,  by 
means  of  an  entirely  straightforward  generalization  of  the  well-known  "subset 
construction"  used  in  the  proof  of  Theorem  11  of  [21],  we  obtain 

THEOREM  1.10.  If  IK  is  a  nondeterministic  2-tree  acceptor,  then  a  deterministic 
2-tree  acceptor  SI'  such  that  T(3I)  ■  T(3I' )  can  be  effectively  obtained. 


The  following  theorem  and  its  corollary  are  also  analogous  to  corresponding 
results  of  automata  theory.  Their  proofs,  however,  although  based  upon  ideas 
similar  to  those  in  the  proofs  of  the  corresponding  results,  do  entail  some 
additional  technicalities. 
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THEOREM  1.11.  Let  81  ■  <S,t,SQ,D>  be  a  E-tree  acceptor.  Then  T(8l)  j4  if 
and  only  If  there  exists  a  tree  t  £  T(81)  such  that  ||t||  <  S. 

PROOF.  We  need  only  establish  the  "only  If"  part  of  the  equivalence.  For  any 
t  £  let  n(T)  be  the  cardinality  of  the  set  of  w  £  dom(T)  with  J  vj  i  S. 

We  wish  to  show  that  If  T(8l)  j4  (J  ,  then  n(T)  ■  0  for  some  t  £  T(8l).  We  shall 
give  a  procedure  which,  when  applied  to  any  given  t  £  T(8l)  such  that  u(t)  >  0, 
yields  a  tree  t'  £  T(8l)  with  n(T* )  <  n(-r).  Applying  this  procedure  finitely 
many  times  leads  to  a  tree  t' 1  £  T(8I)  such  that  n(T")  “0. 

Accordingly,  let  t  £  T(8l)  be  such  that  n(i)  >  0,  let  w  be  a  terminal  of  t 

such  that  jwj  2  S,  and  let  n  be  an  S-tree  compatible  with  t.  Now  wa  £  dom(n) 

and  |waj  >  S;  hence,  there  exist  words  x,  y,  z  such  that  y  j4  e,  wa  ■  xyz,  and 

TT  *  TT  •  Let 
x  xy 

tt'  -  tt[x  /  TT^xy], 
t'  ■  t[x  /  T^xy]. 

Then  tt'  is  compatible  with  t',  tt^  ■  tt£,  and  hence  t'  £  T(8l).  Because  y  f  e, 
we  have  w  4  dom(T'),  and  since  dom(T* )  c  dora(T),  it  follows  that  n(-r')  <  n(T). 

COROLLARY  1.12.  If  81  is  any  tree  acceptor,  then  it  is  effectively  decidable 
whether 

(i)  T(81)  -  0; 

(ii)  T(81)  is  finite. 
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PROOF.  Part  (l)  Is  Immediate  from  Theorem  1.11,  since  the  set  {t  :  ||tI|  <  S] 
is  finite  and  It  Is  effectively  decidable  whether  t  €  T(SU).  We  shall  establish 
part  (11)  by  showing  that  T(3I)  Is  Infinite  If  and  only  If  the  set 

A  *  {t  :  ||t||  £  S  and  t  €  T(3J)} 

Is  not  empty  and  that  it  is  effectively  decidable  whether  A  ■  0. 

Clearly,  if  T(8l)  is  infinite,  thenAj*0.  Now  assume  that  A  f  0.  Let 
%  T,  tt,  x,  y  be  as  in  the  proof  of  Theorem  1.11,  and  note  that  t  f  A.  We 
define  trees  6  ^ >  t/*1^  €  for  each  finite  n  by  recursion: 

(o)  (o) 

TV  7  ■  T,  TTX  7  *  TT, 

T(n+l)  .  T[xy  /  T^^x]  TT^n+1^  ■  Tt[ Xy  /  TT^^x]. 

Then,  for  each  n,n^  is  compatible  with  t^,  rr^n^  ■  tt^,  and  hence  £  T(8l). 
This  shows  that  A  f  (J  implies  T($l)  is  Infinite. 

Our  demonstration  that  A  +  (J  is  effectively  decidable  involves  a  modification 
of  the  construction  in  the  proof  of  1.11.  Without  sacrificing  the  essential 
properties  of  the  procedure  given  there,  we  may  add  the  requirement  that  x  be 
of  maximal  length  in 

{x'  :  tt  ,  ■  tt  ,  ,  for  some  y',  z'  such  that  x'y'z'  ■  wa  and  y'  j4  e}. 
x  x  y 

From  this  maximality  condition  on  x  it  follows  that  |y|  £  S.  Now  suppose  that 
the  transition  from  t  to  t'  is  the  last  application  of  the  procedure  in  the 
proof  of  1.11,  viz., 
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t,  t'  €  T(S1),  ]|t||  iS,  r'  -  t[x  /  t|  xy],  and  ||t'I|  <  S. 

Then  ||t||  ■  ||t*  ||  +  jyj  and  hence  S  £  ||t||  s2  •  S,  Thus,  A  M  if  A1  +  0,  whtrs 

A'  -  {t  :  t  €  T(3i)  and  S  s  ||t||  s2  •  S}, 

Clearly,  It  Is  effectively  decidable  whether  A'  j*  0. 

Many  characterizations  of  the  regular  sets  are  known  in  the  literature. 

The  earliest,  due  to  Kleene,  states  that  a  set  of  words  is  regular  Iff  it 
is  the  set  of  words  accepted  by  some  finite  automation.  Among  the  others,  we 
have,  for  example,  that  the  regular  sets  coincide  with  the  sets  generated  by 
right-linear  grammars  (Chomsky  and  Miller  [6]),  with  the  sets  definable,  in  a 
special  sense,  in  a  formal  language  (Buchi  [1];  Elgot  [10]),  and  with  the  sets 
which  are  the  unions  of  some  of  the  equivalence  classes  of  a  congruence  relation 
of  finite  index  (Myhill  [20]).  In  this  paper  we  shall  add  two  new  characteriza¬ 
tions  of  the  regular  sets  to  the  list;  these  are  Theorem  1.16  and  Corellary  3. 11. 

It  seems  natural  to  inquire  whether  some  of  the  characterizations  of  the 
regular  sets  can  be  generalized  to  characterizations  of  the  recognizable  sets. 
This  is  indeed  the  case.  Thatcher  and  Wright  in  their  paper  [28]  give  such  a 
generalization  of  the  *  characterization"  of  the  regular  sets.  Here,  we 

shall  develop  a  characterization  of  the  recognizable  sets  which  generalizes 
Theorem  3*6  of  Elgot  [10];  many  of  the  ideas  involved  are  closely  related  to 
those  of  Medvedev,  [18].  It  turns  out  that  this  particular  characterization  is 
well  suited  to  our  later  work  in  Sections  2  and  3. 
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If  L  is  any  alphabet  and  a,  a',  a"  f  Z  U  {e}#  we  denote  by  Eg(<r,o' ,o' • ) 
the  eet  of  all  E-trees  t  such  that,  for  some  w,  tw  ■  o,  t  ■  o' ,  and  Twb  “  o"  . 
Note  that  In  particular,  Eg(€,e,€)  ■  E^,  while  if  one  of  o',  o"  is  not  e,  then 
Ej,(€,o',o")  ■  0.  For  o  €  £>  the  condition  that  ■  o  for  some  w  €  fr(«r)  is 
expressed  simply  by  t  €  Ej,(o,e,e). 

Given  two  alphabets  E^  and  E g,  we  say  that  a  mapping  g  :  L*  -  E#  Is  a 
projection  (of  E^  into  e|)  if  g(A)  "A  and  (g(T))y  ■  g(Tw)  for  all  w.  (In 
other  words,  a  projection  is  the  natural  extension  of  a  mapping  of  E^  into  Eg 
to  a  mapping  of  E#  into  l|.)  If  we  are  given  a  mapping  of  E^  into  Eg,  we  speak 
of  the  projection  defined  by  this  mapping,  with  the  obvious  meaning. 

Let  R  be  any  ternary  relation  on  E  U  (e}>  We  say  that  a  tree  t  P  Z^  is 
R-consistent  if  holds  for  every  w  €  {a,b}  • 

DEFINITION  1.13«  The  class  ft  is  the  least  class  of  sets  containing  each 
Eg(o,o' ,o" )  and  closed  under  the  Boolean  operations  (i.e.,  U,fl.  amd  — )  and 
under  arbitrary  projections. 

LEMMA.  1.14.  Let  E  be  any  alphabet,  A  £  E^,  and  B  £  E. 

(i)  If  R  is  a  ternary  relation  on  E  U  ft]/  then  the  set  of  R-conslstent 
trees  is  a  member  of  R. 

(li)  If  A  <  u>,  then  A  £  ft. 

(ill)  If  A  €  ft,  then  {t  :  t  g  A  and  t£  €  B}  €  ft* 

(iv)  If  A  €  R,  then  {t  :  t  €  A  and  tw  €  B  for  every  w  e  fr(T)} 

is  a  member  of  ft. 
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PROOF.  To  prove  (1),  we  lot  C  bo  tho  union  of  tho  ooto  B^Co^o'o'  )  ouch  that 
R(a,o'o' ')  does  not  hold,  end  find  that  C  la  tho  aot  of  R-conslstent  trooa. 

(Of  course,  I*  £  ft*  since,  aa  noted  above,  E*  ■  E^(«£,c,e).) 

To  establish  (11),  It  suffices  to  show  that  (t)  €  R  for  every  t  £  If 
t  ■  A,  then  (t)  ■  £*  —  Uag£  ^Xo,ctc)»  Now  suppose  t  f  A.  For  each  w  £  dom(«r), 
let  be  a  distinct  new  symbol,  and  put  -  c  for  each  w  {  dom(T).  He  let 

IT  ■  {5^  :  w  £  dosi(  t)  ),  and  defines  the  relation  R  on  TT  u  {«)  by 
R(5^W^5^W*^5^Wb^)  for  every  w.  There  Is  Just  one  R-conslstant  tree  tt  £  TT^ , 
end,  by  (i),  {tt}  £  ft*  Let  g  :  TT*  •*  £*  be  the  projection  defined  by  g(5^)  ■  Ty 
for  each  w  £  doB(-r).  Then  g({n})  ■  {t},  so  {t}  £  R* 

Next,  assuam  that  A  £  ft.  Let  5  be  a  symbol  not  In  E,  and  put  E'  ■  £  U  {?}• 

Let  R  ■  (£'  u  {e})  x  (E  u  {c})  x  (E  U  {«}),  end  let  C  be  the  set  of  R-conslstent 

£' -trees.  Then  C  c  »  by  (l),  end  for  t  £  C  we  have  ■?  only  In  case  w  ■  c. 

For  each  o  £  E,  p  is  the  projection  of  E^lnto  E^de fined  by  p  (5)  *  a  and 
o  a 

p^(u)  ■  u  for  ell  u  £  £.  He  then  have 

{t  :  t  £  A  and  t£  £  B}  -  U^Cp^C  -  £#)  0  A]. 

This  proves  (ill). 

Finally,  to  establish  (Iv)  we  merely  note  that 
AMI*  ~U0^bu{€}^:(o#€;€)3  -  {t  :  t  £  A  and  tw  £  B  for  every  w  £  fr(-r)}. 

THEOREM  1.1$.  The  class  ft  coincides  with  the  class  of  recognisable  sets. 


24  July  1967 


20 


TM-738/035/00 


PROOF.  We  begin  by  showing  that  i  contains  avsry  rscognlsabls  set.  Let 
U  ■  (S,t,sQ,D)  by  any  E-tree  acceptor.  Putting  TT  ■  S  x  E,  we  let  R  be  the 
ternary  relation  on  TT  u  {c}  such  that,  for  s,  s',  a"  e  S  and  o,  o',  o' '  f  E, 

R (<a,a>,<s',o’>,<a“,oM»  Iff  t(e*,a”,o)  -  a, 

R(<i,ff>,£,<»",o">)  iff  t(so,e",a)  -  e, 

*(<*ia>,<e',o,>,€)  iff  t(e',*o,o)  •  e, 

and 


*(  <e,o>,€,c)  iff  t(so,eo,o)  -  e. 

Let  C  be  the  set  of  R-conslstent  trees;  then  C  c  ft  by  1.14  (1).  Let 

Po  :  TT^-*  S#,  p^  i  TT^ -•  E^  be  the  projections  auch  that,  for  any  (e,o)  f  n, 

Po(<s,ct»  ■  e  and  P1((e,a»  ■  a.  >*ov  for  any  p  ^  8*,  let  f(p)  be  the  tree  p* 

such  that  dom(p')  ■  {e}  u  {wa,wb  :  ’/  £  doa(p))  and  p^  ■  sq  for  each 

u  £  dom(p')  —  dom(p).  The  following  three  propositions  can  now  be  proved 

simultaneously  by  tree  induction: 

(i)  Pl(C)  -  E# 

(11)  if  tt  €  C,  then  rr^v  f  C  for  any  v, 

(ill)  f(p0(n))  is  ||-cosq>atlble  with  Pj(tt)  €  C; 

We  omit  the  tedious  but  entirely  routine  argument  required.  The  subset  C'  of  C 

consisting  of  tftose  treea  tt  such  that  f(p0(n))€  €  D(l.e.,  such  that  n£  f  D  x  E, 

or  tt  ■  A  in  case  sq  f  D)  is  a  member  of  t  by  1.14  (ill);  we  then  have 
p^c')  •  T(I),  and  hence  t(U)  €  *• 
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To  complete  the  proof  of  Theorem  1.15,  we  must  show  that  every  element  of 
ft  is  recognisable.  In  view  of  Theorem  1.7,  it  suffices  to  show  that  each 
Ej.(a,a',o' ' )  is  recognisable,  and  that  the  projection  of  a  recognisable  set  Is 
again  a  recognisable  set. 


Let  £  be  an  alphabet,  and  o,  o’,  a* '  €  £  U  {«}•  We  first  assume  that 
a  t  €.  For  each  |i  ^£  u  (c),  let  s^  be  a  distinct  new  symbol,  let  sQ  be  another 
symbol  not  among  these,  and  put  S  ■  {s^}  u  H  €  £  U  {e ) } .  The  function 

t  :  S  x  S  x  £  -*  S  Is  defined  es  follows:  for  |i  £  £,  j*',  p' '  e  £  (j  {e}, 


t(s^,,s^t,U)  -  aD  if  p  -  o,  -  o',  and  p"  -  a", 
■  s  otherwise. 


and 


“  *D' 

Putting  U  •  <S,t,S£,  ISjj)/  we  have  that  U  is  a  £-tree  acceptor  and  T(tl)  ■ 
^,(o,o',o");  thus,  E j.(a,o',a")  is  recognisable  whenever  o  *  c.  In  case  o  ■  e, 
then  Ej.(o,o' ,o' ')  Is  either  £^  or  t;  both  of  these  are  recognisable  sets,  since 
If  11  ■  (S,t,so,D)  is  any  £-tree  acceptor  such  that  D  •  8,  then  T(tl)  ■  £^, 
whereas  If  D  ■  t,  the  T(V)  ■  t* 

Finally,  we  assume  that  £^,  £g  are  two  alphabets  and  that  g  Is  a  projection 
of  Z*  Into  £^.  We  wish  to  show  that  If  A  c  £^|  Is  recognisable,  then  g(A)  Is 
recognisable.  Let  II  ■  (S,t,so,D)  be  a  £-tree  acceptor  such  that  T(ll)  ■  A. 
Without  loss  of  generality,  we  may  assume  that  g  maps  £j  Into  £ Let 
•  -  <8,t',{s0},D>  where 
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( 


t'(s,s',a)  *  {s"  :  a"  *  t(s,s',p,)  for  some  p,  such  that  g(n)  ■  o), 

for  each  a  €  Eg*  ®  *-8  a  nondetermlnlstlc  Eg-tree  acceptor.  A  straightforward 
argument  by  tree  Induction  shows  that  an  S-tree  tt  Is  C-compatible  with  a 
Zg-tree  t  Iff  tt  Is  ^compatible  with  some  Ej-tree  t'  such  that  g(T')  ■  t. 

From  this  It  follows  that  g(A)  ■  T(8)  and  hence  that  g(A)  is  recognizable. 

As  a  consequence  of  Theorem  1.15,  we  have  that  all  the  properties  of  ft 
given  In  Definition  1.13  and  Theorem  1.14  apply  to  the  class  of  recognizable 
sets.  We  shall  often  make  use  of  this  fact  without  explicitly  citing  1.13,  1.14, 
and  I.15. 

THEOREM  1.16.  A  set  X  s  {a,b}*  is  regular  if  and  only  if  X  ■  U  fr(r)  for 
soma  recognizable  set  A. 

PROOF.  Assume  that  X  is  regular  and  let  91  ■  (S,t,sQ,D)  be  a  {a,b}-automaton 
such  that  T(9l)  ■  X.  Let  J  be  the  subset  of  S  X  (S  U  {e } )  x  (S  (j  {e })  such 
that  (s,  s',s">  £  J  iff  either  s'  ■  e  and  s"  ■  t(s,b),  or  else  s"  ■  e  and  s' 
s'  ■  t(s,a).  Let  A'  be  the  set  of  J-conslstent  S-trees  r  such  that  t£  ■  sq; 

A'  is  recognizable  by  1.14  (i),  (ill).  A  simple  argument  by  induction  shows 
that  every  w  £  {a,b}  is  a  terminal  of  some  member  of  A*.  Now  suppose 
T  f  A'  and  w  £  dom(T).  We  shall  prove  by  induction  on  |wj  that  t(w)  ■  t  . 

If  w  -  c,  the  t(w)  -  8q  ■  t£.  If  |w|  >  0,  say  w  ■  ua,  and  t(u)  -  tu,  then,  by 
the  J-conslstency  of  t,  we  have  "  t(Tu,a),  and  hence,  t(w)  ■  t(t(u),a)  *  t  . 

Now  let  A  ■  {t  :  t  £  A  and  tw  €  D  for  w  f  fr(>r)};  then  A  is  recognizable,  and 

from  the  remarks  above,  t(w)  g  D  iff  w  e  fr(T)  for  some  t  £  A.  It  follows 

thatUT6A  -T(9I)  m  X.  ( 
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Conversely,  assume  that  A  Is  recognizable  and  X  ■  (J  a^(t)>  Let 
51  ■  <S,t,sQ,D)  be  a  Z-tree  acceptor  such  that  T(U)  ■  A.  We  define  a  sequence 

t  ■>* 

of  sets  w  £  £a, b }  ,  as  follows: 

D  »  D, 
e  ’ 

Dwa  “  {s  :  t(s,t(r),a)  6  Dy  for  some  t  €  Z^  and  a  <rZ}, 

_  U 

Dwb  ■  {s  :  t(t(<r),s,a)  £  Dy  for  some  t  £  Z  and  a  €  2}* 

Now  let  Ww  ■  <S,t,sQ,Dw)  for  each  w  £  {a,b}*.  Then  T(l^)  ■  {t|^w  :  t  €  T(ll)}, 
so  that  w  £  (Jt^a  fr(  t )  iff  Z  n  T(l^)  t  0.  Let  8  ■  <B,r,D,F)  be  a  {a,b)-automaton, 
where 

B  -  {S'  :  S'  c  S  and  S'  >*0}, 

and  for  each  S'  £  B, 

r(S',a)  *  {s  :  t(s,t(T),o)  £  S'  for  8°me  t  £  Z1^  and  a  f  Z}; 
r(S',b)  ■  {s  :  t(t(T),s,o)  £  S  for  some  t  £  Z^  and  a  €  £}, 
and  finally, 

F  *  {S'  :  S'  c  S  and  t(so,8o,a)  €  S'  for  *ome  o  €  £}• 

— 

Let  w  £  {a,b}  ;  it  follows,  by  Induction  on  |wj,  that  r(w)  "  V  and  since 
w  €  T(8)  iff  t(80>80#o)  €  r(w)  for  some  c  £  Z,  we  then  have  that  w  £  T(8)  iff 
Z  n  T(l^)  *  0,  i.e.,  iff  w  e  UTeAf*(T). 

The  construction  of  the  automaton  8  from  the  given  tree  acceptor  II  in  the 
proof  of  Theorem  1.16  may  be  made  effective;  we  need  merely  note  that  there 
exists  a  tree  t  such  that  t(t)  ■  s  iff  there  exists  such  a  tree  depth  <  S. 
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Zxcept  In  Definition  1.1,  we  have  so  far  restricted  consideration  to  trees 
of  order  2.  The  modifications  to  our  development  required  to  effect  the 
transition  to  trees  of  any  finite  order  p  >  0  are  entirely  straightforward:  for 
example,  the  notation  o[t,t']  is  changed  to,  for  any  n  <  p, 

a[T,T',...,r(p)]  -  (...(c[ao  /  t])  [ax  /  T'])...[ap_1  /  t(p)]; 

'  in  Definition  1.2,  the  transition  function  t  has  domain  S^p^  x  E  instead  of 

X  E  (where  -  S  and  x  s);  and  in  Definition  1.13,  we 

replace  E^a, a' , a' ' )  by 

"  (t  2  for  some  w,  tw  -  a,  Twa  -  oQ,...,  tW4  -  cr^}. 

0  p 

With  these  modifications,  we  can  extend  our  concept  of  ‘cognisable  set"  to 
apply  to  sets  of  trees  of  any  given  finite  order  p. 

In  the  remaining  sections  of  this  paper,  we  shall  assume  that  these 
modifications  have  actually  been  carried  out.  Thus,  we  shall  of  tree 

acceptors  of  order  p  and  recognisable  sets  of  order  p,  and  we  shall  cite 
theorems  of  Section  1  with  the  understanding  that,  if  necessary,  they  are  to 
be  modified  to  apply  to  trees,  acceptors,  etc.,  of  srbltrary  finite  orders. 

A  E-tree  of  order  1  is  essentially  the  same  as  a  finite  sequence  of 
members  of  E,  i.e.,  a  E-word.  Consequently,  one  may  identify  tree  acceptors 
of  order  1  with  ordinary  finite  automata  and  the  recognisable  sets  of  order  1 
with  the  regular  aets,  so  that  automata  theory  becomes  a  special  case  of  the 
theory  of  tree  acceptors. 
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It  is  An  easy  consequence  of  Definition  1.1  that  a  tree  t  of  order  p  is 
also  of  order  p'  for  any  p'  >  p.  We  nay  naturally  Inquire  whether  a  recogni¬ 
zable  set  of  trees  of  order  p  remains  a  recognizable  set  when  it  is  regarded 
as  a  set  of  trees  of  order  p'  >  p.  This  is  indeed  the  case;  in  fact,  by  simple 
constructions  of  tree  acceptors  we  obtain 

LEMMA  1.17.  Let  U  be  a  tree  acceptor  or  order  p  >  0. 

(I) j  If  p'  >  p,  then  there  is  a  tree  acceptor  II'  of  order  p*  such  that 

T(il)  -  T(M'). 

(II)  If  p  >  p'  >  0  and  every  tree  in  T(ll)  is  of  order  p',  then  there  is 
a  tree  acceptor  M'  of  order  p*  such  thst  T(J|)  •  T(tl' ). 

(ill)  If  p'  >  p  >  0,  then  a  set  A  of  trees  is  a  r# cognisable  set  of  order 
p  if  and  only  if  A  is  a  recognizable  set  of  order  p'. 

As  a  consequence  of  Lemma  1.17,  we  have  that  Theorem  1.7  holds  even  if 
no  restriction  is  placed  upon  the  order  of  the  recognizable  sets  Involved. 

Lemma  1.17(111)  states,  roughly  speaking,  that  recognlzablllty  is  a  property 
Independent  of  order,  so  that  we  may  describe  a  set  as  recognizable  without 
specifying  its  order. 

Notice  that  Theorem  1.16  may  now  be  Improved  as  follows:  It  places  no 
essential  restriction  on  the  regular  sets  to  assume  that  their  underlying 
alphabets  are  always  subsets  of  {a^  :  i  ■  0,  1,  ...),  and  under  this  assumption 
we  have  that 

A  set  X  is  regular  if  and  only  if  X  ■  Ut^*(t)  for  some 
recognizable  set  A. 
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SECTION  2.  A  CHARACTERIZATION  OF  CONTEXT-FREE  LANGUAGES 

In  this  section  we  shall  give  an  example  of  the  application  of  the 
results  of  Section  1  to  the  theory  of  algorithmic  languages;  namely,  we  shall 
characterize  the  context-free  languages  by  means  of  recognizable  sets.  These 
results  were  first  obtained  by  Mezei  and  Wright  [19],  although  their  formula¬ 
tion  is  technically  different  from  ours.  Ginsburg  [14]  is  our  principal  source 
for  notation,  terminology,  and  results  concerning  context-free  languages. 

A  context-free  grammar  is  a  4-tuple  G  ■  (V,Z,P,U>  where  V  and  I  are 

alphabets,  I  C  V,  P  is  a  finite  subset  of  (V-Z)  x  V*,  and  u  £  V.  Elements  of 

V-Z  are  called  variables,  elements  of  Z  are  constants  and  elements  of  P  are  called 

productions:  a  production  <g,v)  £  P  is  denoted  by  5  -  v.  For  u,  v  £  V*,  we  write 

u  **G  v  (or  simply  u  =»  v  when  G  is  understood)  if  for  some  uq,  Uj,  v'  £  V*, 

* 

and  5  (f  V,  we  have  u  ■  “0?u1>  ?  -  v*,  ***d  v  ■  uqv'u^.  We  write  u  «*G  v 

if  there  exists  a  finite  sequence  of  words  uq,  ...,  c  v*  such  that 

u  ■  uo,un  -  v,  and  for  each  i  <  n,  ut  *G  ut+1;  the  sequence  uq,  ...,  ur  Is  then 

called  a  derivation  of  v  from  u.  The  language  generated  by  G,  L(G),  Is  the 

set  of  words  w  f  Z  such  that  u  »  w.  Of  course,  if  u  p  Z,  then  L(g)  -  (u). 

t 

A  set  of  L  is  a  context-free  language  if  L  ■  L(G)  for  some  context-free  gramnar  G. 

A  grammar  G  ■  (V,Z,P,^)  is  called  €-frce  if  it  has  no  production  of  the 
form  5  —  a.  Theorem  1.8.1  of  [14]  states  that  for  any  context-free  language 
L  there  exists  a  e-free  grammar  G  such  that  L(G)  -  L  —  {e}.  Another  result  we 
require  from  the  theory  of  context-free  languages  (c.f.  [14],  1,4.6)  is 

the  following:  for  any  5  g  v  -  2,  and  u  ^  V*,  5  u  iff  either  §  -  u,  or  there 


« 
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* 

Is  a  production  5  qq  ...  In  P,  and  word*  uq>  ...,  u^_1  f  V  such  that 
„  # 

for  1  <  n,  Ci  *  ui^  arM*  u  "  uo  *'*  un-l* 

Given  an  e-free  grammar  G  ■  (V,£,P,|a),  V-trees  can  be  aaaoclated  In  a 

natural  way  with  derivations  $  ■  u  •  •••  •  u^_^;  where  g  g  V.  In  fact  when- 
*  # 

ever  g  ■»  u  f  V  ,  there  is  at  least  one  such  V-tree  t  such  that  t£  ■  g>  and 

u  ■  t  ...tw  ,  where  w  ,  ...,  w  are  the  terminals  of  t  In  lexicographical  order, 
o  n 

The  formal  details  of  the  correspondence  between  V-trees  and  derivations  are 
set  forth  in  the  following  definitions  and  lemma. 

DEFINITION  2.1.  The  operator  Q  on  arbitrary  trees  is  defined  by  tree  recursion: 
(i)  Q(A)  -  €, 

(11)  Q(ct[t^°^,  ...,t(P)])  •  a  if  ■  ...  ■  ■  A, 

■  Q(t^°^)...Q(t^P^)  otherwise. 

Q(t)  is  simply  the  concatenation  of  the  symbols  appearing  at  the  terminals 
of  r,  taking  the  terminals  of  t  In  lexicographical  order. 

DEFINITION  2.2.  Let  G  ■  (V,£,P,}i)  be  an  e-free  grammar.  Cg  Is  the  set  of 
V-trees  defined  by  the  conditions 
(i)  V  c  Cc, 

(11)  if  ...,  6  Cc,  and  g  -.  ...  then 

g[r(0),...,T(n)]  P  CG. 

The  order  of  the  trees  In  C_  Is  the  maximum  of  the  set 

V 

{1}  U  l|u|  :  g  u  is  in  P  for  some  g  p  V). 
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( 

LEMMA  2.3.  Let  G  ■  be  an  €-free  grammar,  5  €  V  and  u  £  V*.  Then 

g  u  Iff  there  la  a  t  £  CG  such  that  t£  ■  5  and  Q(t)  ■  u. 

Proof.  Flrat,  assume  5  /  u.  We  proceed  by  Induction  on  the  length  of  the 

derivation  establishing  g  =>*  u.  If  this  length  Is  0,  than  g  ■  u  and 

* 

g  £  CG«  Otherwise,  there  are  . ..,  ^  £  V  and  uq,  ur  £  V  such 
that  5  -•  Co  •••  Cn>u“u0***uni  and  for  each  i,CA  =**  by  means  of  a  shorter 
derivation.  Applying  the  Inductive  hypothesis,  we  obtain  trees  £  Cg  such 
that  ■  Cj_  *nd  Q(t)^)  “  u^.  Putting  t  ■  g[T^, .  we  find 

t  £  C0  and  Q(t)  -  u. 

Conversely,  assume  T  €  CG'  Te  ■  g,  and  Q(t)  ■  u.  We  proceed  by  tree  In¬ 
duction.  T  ■  A  is  Impossible.  If  ||t||  ■  1,  then  T  ■  g  ■  Q(t),  and  g  **  g. 

If  ||t||  >  1,  then  t  ■  g[T^°^, . .  .,t^ ]  for  some  t^,  . . .,  f  CQ  and  g  such 
that  g  -*  T^°^...T^n^.  No  is  A,  so  Q(t)  ■  Q(t^°^)*  •  •Q(t^).  But  by  the 

inductive  hypothesis,  =**  Q(t^),  for  la.  Hence, 

?.*Q(T(o))—<l('(n))  -Q(t)  -u. 

The  set  of  trees  t  £  Cg  with  t£  ■  u  and  Q(r)  £  I  ,  where  G  ■  (V,Z,P,p,) 

Is  a  e-free  grammar,  Is  simply  the  set  of  "derivation  trees"  for  G,  a  concept 
well-known  In  the  literature.  This  set  will  be  denoted  by  A^.  The  impact  of 
Lemma  2.3  Is  simply  that  L(G)  ■  Q(A^). 

LEMMA  2.4.  If  L  is  a  context-free  language,  then  L  ■  Q(A)  for  some  recognizable 
set  A. 


PROOF.  Let  G  be  a  grammar  such  that  L  -  {e}  ■  L(G).  We  will  show  that  Aq  is 
recognizable.  Let  p  be  the  length  of  the  longest  word  u  which  occurs  in  a 
production  g  u  in  P.  The  p  +  1  place  relation  R  on  Z  U  {e}  is  defined  as 
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follows:  for  any  §,  . ..,  m  <  p,  R(5,fQ, . .  •tCmf  •  •  *>€)  and  only 

In  P.  Then  is  the  set  of  R-consistent  trees  t  such  that 
t  ■  n  and  tw  €  2  for  every  w  fr(-r)*  Thus,  AQ  Is  a  recognizable  set.  The 
desired  result  now  follows,  since  we  have  either  L  ■  Q(A^)  or  L  ■  Q(Aq  U  {A}) 
according  as  e  ^  L  or  c  g  L,  while  both  Afl  and  AQ  U  {A}  are  recognizable. 

Lenina  2.4  may  come  as  no  surprise  to  those  familiar  with  the  theory  of 
context-free  languages.  Somewhat  less  obvious  is  the  fact  that  the  converse 
of  2.4  also  holds — that  Q(A)  is  a  context-free  language  whenever  A  is  a 
recognizable  set. 

THEOREM  2. 5.  A  set  L  is  a  context-free  language  if  and  only  L  ■  Q(A)  for  some 
recognizable  set  A. 

PROOF.  The  "only  if"  part  has  already  been  established  as  Lemma  2.4.  We  shall 
show  that  if  81  ■  <S,t,sQ,D)  is  a  tree  acceptor  (of  order  p)  then  Q(T(ll))  is  a 
context-free  language.  Let  ^  be  a  new  symbol  not  in  Z  or  S  x  (Z  u  {c}),  and 
let  G  be  the  context-free  grammar 

G  -  <Z  U  (S  x(Z  U  {e})), Z,P,n> 

where  P  contains  the  following  productions: 

H  <r,8>  for  some  r  f  D  and  8  q  Z  y  {e}, 

<so>0  -  e, 

o 

The  author  would  like  to  express  his  thanks  to  the  referee  for  suggesting  this 
proof,  which  is  considerably  simpler  than  the  original. 
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<t(»o,  •*  for  all  a  €  2, 

“*  (Of®]^  •••  (•p*®p)>  f°r  *£  £  2, 

and  fi1  €  2  u  {e)  with  fi^  ^  €  for  at 
laatt  one  1. 

First  we  shall  prove 

(1)  <t(T),T£>  **  Q(t)  for  all  t  f  2 

by  tree  induction.  If  t  ■  A*  we  have  t(r)  *  *0>  t£  ■  c,  Q(t)  “  c,  and  need 
merely  note  that  <*o,€)  -•  e.  If  r  ■  a  €  2,  then  t(r)  ■  t(a0,  . ..,ao,o), 
and  t£  ■  Q(t)  ■  a.  Then  <t(so,...,so,o),a>  -  Q(t)  by  definition  of  T.  Finally, 
auppoae  t  ■  oCt^, with  at  least  one  ^  A»  By  the  inductive 
hypothesis,  <t(T^),T^>  •*  Q(t^),  for  i  ■  1,  ...,  p.  Now  t(-r)  -  t(t(<r^)# 
...,t(*/P^)*CT),  and  since  at  least  one  is  not  A#  we  have 

<t(r),o>-  <S(t(1)),t'°>  ...  <t(T(p)),T'p)> 

by  definition  of  P.  Since  Q(t)  •  Q(t^)«.»Q(t^p  ),  we  have  shown 
<b(T),cx>  «•*  Q(t). 

Next  we  shall  prove 

(2)  If  (s,a)  •*  u  <r  Z  ,  then  u  ■  Q(r)  for  soaw  t  with  t(r)  ■  a  and  r£  m  o> 

This  will  be  done  by  induction  on  the  length  n  of  the  shortest 

*  # 
derivation  establishing  (s,o)  *»  u.  n  ■  0  is  lmposilble  sines  <s,a)  ^  2  .  If 

n  •  1  then  the  only  possible  production  is  <t(so,...,a 0,a),a)  -  a,  so  we  must 

have  u  ■  a  end  s  ■  t(s  , a)*  We  merely  take  t  ■  a.  If  n  ■  1  and  u  ■  e 

o  o 

then  the  only  possible  production  is  <sq,€>  -•  e,  so  take  t  ■  A»  Finally, 
suppose  n  >  1  and  (2)  holds  whenever  the  underlying  derivation  has  fewer  than 
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n  seeps.  There  Is  a  production  <a,o)  -•  •••  (Op^Sp)  ftn^  *or^*  ui>  •••# 

^  £  Z  such  Chat  (s^d^)  •  u^  (with  derivations  shorter  than  n)  and  u  ■  u^...u  . 
By  definition  of  P,  a  ■  t(s1, . ..,sp,o),  and  by  the  inductive  hypothesis,  there 
are  trees  t^,  i  ■  l,  . ..,  p,  such  that  t(t^)  ■  e^,  ■  dj,  and  Q(t^)  “  u^. 

Lit  t  ■  oCt(1),...,t(p)].  Than  t(<r)  ■  s  and  t  •  o»  Since  at  leaat  one  d£  is 
not  c ,  at  lsast  one  ia  not  aj  hence,  Q(t)  ■  Q(t^)...Q(t^)  *  u.  This 
completes  the  proof  of  (2). 

Suppose  T  f  T(ll).  By  (1),  <t(r),Tc>  •*  Q(t).  Since  t  f  T(h), 
t( t)  €  D,  so  u  -  <t(T),T€>.  Then  |i  •*  Q(t),  and  it  follows  that  Q(T(«))  c  L(C). 
Conversely,  suppose  u  c  L(C).  For  soae  s  c  D,  d  e  Z  U  {«}>  4  -*  <s,d)  and 
<s,d>  m  u.  We  have  froai  (2)  that  there  is  a  tree  t  such  that  Q(t)  ■  u, 
t(T)  *  s,  and  t(  ■  d.  Since  e  f  D,  this  naans  that  t  c  T(«f),  and  it  follows 
that  L(G)  c  Q(T(«)). 


) 
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SECTION  3.  DECIDABILITY  OF  THE  THEORY  OF  p  SUCCESSOR  OPERATION! 

In  this  section,  vs  apply  the  theory  of  rseotnissbls  sets  to  •  decision 
problem  of  mathaeetlcal  logic:  We  will  shov  that,  for  any  p  <  w,  the  weak 
second  order  theory  of  p  successor  operations  Is  decidable  (Corollary  3.8). 

This  answers  In  the  affirmative  a  problem  of  Buchl,  stated  In  lection  9  of 
[1].  In  case  p  ■  1,  this  result  was  first  reported  by  Buchl  end  Bigot  [5],  and 
published  by  them  In  [1]  and  [10].  Most  of  the  methods  snployed  In  this  section 
are  generalisations  of  those  used  by  Elgot  In  [10]. 

Let  B  be  any  set;  let  p,  q  be  any  ordinals;  for  1  <  p,  let  0^  be  a  m^-ary 
operation  >r  B;  and  for  J  <  q  let  Rj  be  a  n^-ary  relation  among  the  elesMnts  of 
B.  then  v*  say  that  the  system 

in  a  algebraic  structure  of  similarity  type  cr  ■  «*o»  *  •*>-!/  *  •  •  >kp» 
(nf,...,nj,...)^>.  In  case  p  •  0,  so  that  there  are  no  operations,  9  Is 
called  a  relational  structure.  B  Is  the  universe  of  0,  denoted  by  |«| . 

Associated  with  the  similarity  type  cr  of  9  Is  the  following  calculus 
called  the  monadic  second-order  language  of  type  a  (or,  for  brevity,  simply 
"the  language  of  9").  The  logical  constants  of  are  *  (equality),  the 
usual  propositional  connectives  ( A, v, -*>-*,«),  and  the  quantifiers  Vend  3. 

The  nonloglcal  constants  of  are:  For  1  <  p,  a  m^-ary  operation  symbol  0^, 
and  for  j  <  q,  a  n^-ary  relation  symbol  Rj.  (For  purposes  of  clarity,  when  a 
structure  has  an  operation  0  or  relation  R,  we  endeavor  to  use  the  correspond¬ 
ing  boldface  letter  0  or  R  as  its  representative  In  the  formal  language.  This 
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is  not  always  desirable,  and  exceptions  to  this  rule  will  be  made  clear  when 
they  occur.)  There  are  individual  variables  x,  jr,  s,  . . and  monadic  predicate 
(sat)  variablee  X,  Y,  Z,  ...  .  Quantification  ovar  either  kind  of  variable  is 
permitted.  The  notation  £  €  X,  read  1*  a  member  of  X,"  will  be  used  Instead 
of  the  more  usual  Xjr  or  X(^).  The  notion  of  a  term,  or  an  atomic  formula,  and 
the  notion  of  a  variable  being  free  in  a  f  rmula,  are  understood  in  the  usual 
way.  A  sentence  is  a  formula  without  free  variables.  If  P  is  a  formula  of  L, 
whan  we  write,  e.g.,  F(g,x),  we  mean  that  the  variables  jr,  x  occur  free  In  F, 
but  we  do  not  exclude  the  possibility  that  F  has  other  free  variables.  If  g1, 
x'  are  any  other  variables,  then  when  we  write,  e.g.,  F'  m  F(y',x'),  we  mean 
that  F1  is  obtained  from  F  by  substituting  jr'  for  each  free  occurrence  of  jr 
and  x*  for  each  free  occurrence  of  x,  while  making  suitable  systematic  changes 
of  the  bound  variables  of  F  so  as  to  avoid  "conflicts  of  variables." 

Relative  to  a  given  structure  8  of  similarity  type  a  and  a  given  interpre¬ 
tation  of  the  individual  and  set  variables,  the  notions  of  truth  and  satisfac¬ 
tion  are  defined  in  the  usual  way.  The  Individual  variables  will  always  be 
interpreted  as  elements  of  the  universe  |8|.  We  shall  consider  two  different 
interpretations  of  the  set  variables.  In  the  strong  interpretation,  set 
variables  range  over  arbitrary  subsets  of  the  universe,  while  in  the  weak 
interpretation,  only  finite  sets  are  admitted  as  possible  interpretations  of 
the  set  variables.  The  strong  second-order  theory  of  8,  SS(8),  is  the  set  of 
sentences  of  which  are  true  under  the  strong  interpretation,  and  the  weak 
second-order  theory  of  8,  WS(8),  is  the  set  of  sentences  true  under  the  weak 
interpretation.  An  elementary  formula  is  a  formula  without  occurrences  of  set 
variables,  and  ET(8)  is  the  set  of  elementary  sentences  true  in  8. 


24  July  1967 


34 


TM-738/035/00 


If  0  Is  «ny  class  of  formulas,  we  say  that  a  formula  F  Is  a  Boolean 

combination  of  members  of  C  If  F  Is  a  member  of  the  least  class  C'  containing 

C  and  such  that  whenever  G,  H  g  C',  then  G  A  H,  G  V  H,  and  n  G  are  also  members 
of  O'. 

The  sysfcols  £,  IT  are  used  for  Iterated  disjunction  and  Iterated  conjunc¬ 
tion,  respectively;  e.g.,  for  l>  0,  denotes  the  formula  Fq  v  ...  v  F 

Let  F(x,g;X)  be  a  formula  of  with  exactly  the  free  variables  x,  £,  X, 
and  let  x,  y  €  Then  F(x,y,X)  means  that  F  Is  satisfied  when 

x,  £,  X  are  Interpreted  as  x,  y,  X,  respectively.  Of  course,  we  must  also 

specify  whether  the  weak  or  strong  Interpretation  Is  to  be  used.  This  will 
always  be  clear  from  context.  In  fact,  we  shall  rarely  use  the  strong  Interpre¬ 
tation  except  In  Section  5;  thus,  In  the  absence  of  specific  notice  to  the 
contrary,  the  reader  may  assume  that  the  weak  Interpretation  is  Intended. 

DEFINITION  3«1«  Let  0  <  p  <  u).  The  algebra  of  p  successors  Is  the  algebraic 
structure 


“  (Np,SQ,  •  • 

ft 

where  Np  ■  {aQ, . .  •,ap_1}  and  for  each  1  <  p,  Is  the  unary  operation  defined 

t>y 

S^(x)  ■  xa^  for  all  x  f  Np. 

The  monadic  second-order  language  associated  with  71  ,  i.e.,  L. ,  ,vv, 

P  • • •) P“l// 

will  be  denoted  by  Lp,  and  its  p  unary  operation  symbols  by  SQ,  ..., 
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In  the  remainder  of  this  section,  we  shall  assume,  except  where  otherwise 
specified,  that  p  Is  a  fixed  but  arbitrary  positive  Integer. 

There  are  two  main  steps  In  our  discussion  leading  up  to  Theorem  3*7  and 

Corollary  3*3:  First,  we  develop  a  normal  form  for  formulas  In  Lp,  and  secoad, 

we  correlate  a  recognizable  set  A  with  each  formula  F  In  normal  form,  and  show 

that  F  is  satlsfiable  In  31  if  and  only  if  A  +  0. 

P 

The  terms  ^  of  L  are  all  of  the  form  f  ■  S.  .  ..S.  (x),  k  <  u>,  for  some 

p  o  k-1  " 

Individual  variable  x;  the  Integer  k  is  the  rank  of  f.  We  say  that  two 

formulas  F,  G  of  Lp  are  equivalent  and  write  F  —  G  If  they  have  the  same  free 

variables  and  the  universal  closure  of  F  •»  G  is  in  WS(3l  )• 

P 

LEtyMA  3.2.  Every  formula  F  of  Lp  is  equivalent  to  a  formula  G  which  contains 
no  occurence  of  the  equality  symbol,  nor  of  any  term  of  rank  >  1. 

PROOF.  By  Iterative  applications  of  the  two  rules 

(1)  f  »  cp  ~  v  Y[*  €  Y  «  'cp  €  Y] 

and 

(2)  X  «  Y  -  V  u[u  €  X  «  u  6  Y] 

where  i|i,  cp  are  any  terms  and  X,  Y  are  any  set  variables,  we  obtain  a  formula 
F',  with  no  occurrence  of  «,  such  that  F  —  F' . 

Now  suppose  that  S.  ...S,  (x)  is  a  term  of  rank  >  1  (l.e.,  k  >  0)  occurring 
~Jo  -Jk  " 

in  F* ;  this  occurrence  must  be  as  a  part  of  an  atomic  formula  S.  ...S  (x)  £  Y 

_Jo  ~Jk  ~ 

for  some  set  varluble  Y.  We  note  that 
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(3)  Sj  . .  .S j^(x)  e  Y  ^  3  ^  ...  3  Xk[V  ZC^  e  Z  «  x  e  2] 

a  nj^(v  zC^j  €  z  *  s±  (Zj-1)  ez])  a  xk  6  y] 

Thu  desired  formula  G  may  now  be  obtained  from  F'  by  repeated  applications  of 
rule  (3). 


DEFINITION  3 -3  •  A  principal  n-formula  Is  a  formula  In  Lp  of  the  form 


3  5^1<n^Pl  A  Vp  C1,J^' 


where  x  le  any  Individual  variable,  and  for  soma  n  distinct  set  variables, 
3^),...,25ii_1,  each  Ft  Is  either  x  g  X^  or  -i  x  €  X^,  and  each  Gj^  ^  Is  either 
Sj(x)  6  5i  or  5  ^  A  formula 


«!n>"'(«Wl>“<5. . Wl> 

where  H  Is  a  Boolean  combination  of  principal  n  +  m-formulas  and  each  (Q  j) 
Is,  independently  of  J,  either  V  Xj  or  3  Xj,  in  normal  form. 


LEMMA  3.4.  Every  formula  of  Lp  with  no  free  individual  variables  is  equivalent 
to  a  formula  in  normal  form. 


PROOF.  Let  F(X  ,  ...,X  .)  be  any  formula  with  exactly  the  distinct  free  set 

•  “O  '-n-i 

variables  X  , ...,X  ..  By  3*2,  F  —  F'  where  F'  is  a  formula  with  no  occurrence 
of  w  nor  of  any  term  of  rank  >  1.  Note  that  F*  necessarily  contains  at  least 
one  set  variable.  The  two  equivalences, 

V  x  V  Y  H  -  VYVxH, 

3  x  V  Y  H  ~  3  X  V  Y[V  x[x  £  X  -  H]  A  3  x[x  £  X]], 


* 
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apply  to  any  formula  H  In  which  X  does  not  occur  free.  By  iterative  applications 
of  these  equivalences  we  obtain  a  formula  F* 1  —  F'  such  that  no  set  variable 
quantifier  in  F' '  occurs  within  the  scope  of  any  individual  variable  rurntlfler. 
Now  F"  is  equivalent  to  its  prenex  normal  form,  i.e., 


F"-(Q  5)„-(Q  F'"(X, . ^ 

where  XR, . .  .,Xn^_^  *re  *11  distinct,  each  (Q  Xj),  J  ■  n,  . ..,  n  +  m  -  1,  Is 
either  v  or  3  Xj,  and  F,M  (XQ, .  •  **-ntm-l^  cont*in8  no  set  variable  quantifier. 
To  complete  the  proof,  we  must  show  that  F'  ’ '  is  equivalent  to  a  Boolean  combina¬ 
tion  of  principal  n  +  m-formulas. 


Let  C  be  the  class  of  Boolean  combinations  of  principal  n  +  m-formulas  and 
atomic  formulas  jr  £  Xj  or  S^(^)  £  Xj,  where  J  <  m,  i  <  p,  and  £  is  any  Individual 
variable.  Let  C*  be  the  class  of  formulas  equivalent  to  formulas  in  C>  That 
F" '  g  C'  is  shown  by  Induction;  we  will  only  discuss  the  existential  quantifier 
step,  namely,  we  assume  that  G  f  C  and  show  that  3  x  G  €  C'  •  Of  course,  if  x 
does  not  occur  in  G  then  3  x  G  —  G.  Otherwise,  G  may  be  put  in  its  disjunctive 
normal  form,  2  ,G  ,  and  the  quantifier  distributed: 

j l 

3*C~L*Ck  35Gi> 

where  each  G  is  a  conjunction  in  C*  For  each  l  <  k,  all  the  conjuncts  of  G, 
in  which  x  does  not  occur  free  may  be  passed  outside  the  scope  of  the  quantifier; 
i.e.,  we  apply  the  rule  that  for  any  formula  H  and  any  jr  J1  x, 

3  x  [H  A  £  €  X]  ~  3  x  H  A  ^  £X, 
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or  the  similar  rules  concerning  conjuncts  S^jr)  £  X,  or  -1  S^(jr)  €  X. 

Finally,  if  for  any  j  <  n  +  m  such  that  neither  x  £  X  ^  nor  -1  x  £  Xj  occurs  as 

a  conjunct  within  the  scope  of  3  x,  then  x  £  Xj  v  -1  x  £  Xj  may  be  inserted  as 

a  conjunct  and  the  distributive  laws  again  applied;  a  similar  treatment  applies 
when  neither  S^(x)  g  X,  nor  -1  S^(x)  £  Xj  occurs  within  the  scope  of  3  x.  The 

resulting  formula,  G',is  in  C>  C  ~3xG  ,  and  the  variable  x  occurs  in  G' 

only  as  the  bound  variable  in  principal  n  +  m-formulas.  Since  3  x  G  is  equiva¬ 
lent  to  a  Boolean  combination  of  such  formulas  G',  we  have  3  x  G  £  C'» 

t  " 

Lemma  3.4  generalises  Elgot's  Lemma  1,  Section  5.5,  in  [10]  to  Lp  for  p  >  1. 
The  proof  uses  essentially  the  same  ideas.  We  may  note  in  passing  that  the  proof 
of  3.4  makes  no  use  of  special  properties  of  the  operations  or  3lp.  The  lemma 
can  be  proved  for  any  monadic  second-order  formal  language  in  which  there  are  no 
nonlogical  constants  with  more  than  one  argument  place  for  individual  variables: 
We  can  even  introduce  higher-type  predlcte  constants  with  one  individual  variable 
argument  place  and  one  predicate  variable  argument  place;  the  treatment  of  such 
higher-type  constants  would  be  formally  similar  to  the  treatment  of 

For  each  n,  let  be  the  set  of  n-termed  sequences  with  terms  in  the  set 
(n) 

{0,1};  0V  denotes  the  n-termed  sequence  consisting  entirely  of  0's. 

The  order  ot  trees  and  acceptors  discussed  in  this  section  is  assumed  to 
be  p;  thus,  if  TT  is  an  alphabet,  TT^  is  the  set  of  TT  trees  of  order  p. 

DEFINITION  3*5*  Let  t  G  and  let  X  .....  X  .be  finite  subsets  of  N  . 

r  0  n-l  p 

Then  t  represents  XQ>  •••,  Xn_^  if,  for  each  i  <  n  and  any  w  £  N^,  w  £  XA  if 
and  only  if  the  i-th  term  of  tw  i* 
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Every  tree  t  f  ^  represents  exactly  one  sequence  of  sets  XQ,...,Xn_^  c  N^, 
and  every  sequence  of  finite  sets  XQ,...,Xn_^  c  is  represented  by  some  tree 
t  €  E#.  The  tree  f  is  not  uniquely  determined  by  the  sets  XQ,...,  X^_^,  however; 
e.g.,  if  tw  ■  0(n)  for  some  w  £  fr(<r),  then  both  t  and  t[w/a3  represent  the 
same  sets.  Nevertheless,  there  is  always  just  one  minimal  Entree  which  repre¬ 
sents  the  given  sets  XQ,  ...,Xn_^;it  may  be  obtained  as  follows:  Let  t  be  any 
tree  representing  the  sets  XQ, . . .  ,Xfl_^,  and  put 

ij  “  Tw  if  T^W  $ 

■  €  otherwise; 


then  t1  is  the  minimal  tree  representing  XQ, ...,Xn_^. 

Let  us  say  that  two  Entrees  are  equivalent  if  they  represent  the  same 
sequence  of  sets.  If  A  is  any  set  of  Entrees,  we  denote  by  cl(A)  the  set  of 
all  trees  equivalent  to  some  tree  in  A,  and  by  mnl(A)  the  set  of  minimal  trees 
in  cl(A). 


LEMMA  3.6.  If  A  c  En  is  recognizable,  then  so  are  cl(A)  and  mnl(A). 

PROOF.  Let  SI  ■  (S,t,s,D)  be  a  Entree  acceptor  such  that  T(y)  ■  A.  First, 
suppose  that  A  m  mnl(A).  Let  s*  be  a  new  state  not  in  S,  and  put 
8  ■  (S  u  [s*},t' , s*,D'  ),  where  D'  ■  D  (j  {s  }  if  s  £  D,  D'  ■  D  otherwise,  and 
t'  is  defined  as  follows: 


and  if  either  a  t  0V  '  or  some  s^  is  not  s  ,  then 
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(fl0>  *  *  •>  8p_l>0’)  "  t(8Q>  **  •^8p-l^CT) 

where  ■  s ^  if  Sj^  t  s*  end  s|  ■  s  if  1^  ■  8*.  With  A  ■  mnl(A),  it  is  easily 
seen  that  T(fe)  ■  cl(A). 

Now  consider  the  case  that  A  t  mnl(A).  Since  obviously  cl(A)  *  cl(mnl(A)), 
it  is,  in  view  of  what  has  already  bean  proved,  sufficient  to  show  that 
mnl(A)  is  recognisable.  Again,  assume  A  ■  T(U ) ,  y  -  (S,t,s,D>.  Let 
«"  <8,  t",  I,D>,  where  for  all  sQ,...,  sp-l  6  S,  a  £  *n, 

'  (sq, • . sp_^,o)  ■  {t(so,  • » • ) 

and 

I  *  {s  :  t(r)  ■  s  for  some  t  £  {0^}^}. 

Then E  is  a  non-deterrainistic  Z^-tree  acceptor  with  the  following  two  properties: 
(i)  every  t  £  T(£  )  is  equivalent  to  some  member  of  A,  and  (li)  mnl(A)  c  T(c). 
Thus,  mnl(A)  consists  of  those  r  £  T(®)  suc^  that  tw  f1  0'n^  for  each  w  g  fr(«r). 

It  follows  from  1.14  and  1.15  that  mnl(A)  is  recognisable. 

Note  that  in  the  proof  of  3  >6;  the  construction  of  the  nondeterminlstic 
tree  acceptor  s  is  effective,  since  in  the  definition  of  I  we  may  restrict 
consideration  to  those  trees  t  £  {0^}  which  are  of  depth  <  S. 

If  F(X  ,...,X  .)  is  a  formula  of  L  with  exactly  the  free  variables 
v-o  -n-1  p 

•..,?n_>^,  then  we  denote  by  T(F)  the  set  of  those  minimal  Zn~trees  which 
represent  a  sequence  XQ, ...,Xr_^  such  that  F(Xq, ...,Xn_^). 
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THEOREM  3.7.  T(F)  Is  recognizable  for  every  formula  F  with  exactly  the  free 

variables  X.. . . .,X_  . . 

—0  -n-l 

PROOF.  It  is  sufficient,  by  3.4,  to  assume  that  F  is  in  normal  form.  Our 
proof  is  by  induction  on  the  length  of  F.  In  each  case  of  the  Induction  we 
shall  exhibit  a  recognizable  set  equal  to  T(F);  the  reader  should  encounter  no 
difflcullty  in  supplying  the  simple  argument  which  establishes  this  equality. 


If  F  is  a  principal  n-formula,  say  3  x(TT^<nCF^  A  TT^  G^)],  where  F^, 
are  as  in  Definition  3.3,  let  a  €  4e  defined  by  the  condition 

the  1-th  term  of  9  ii  1  iff  F^  is  x  g  X^, 


and  for  J  *  0, 


p  -  1  let  Oj  €  £n  be  defined  by  the  condition 


Now  if  a  *  a  ■ 
o 

a,  aQ,  •  ••> 


the  i-th  term  of  Oj  ii  1  iff  G^  is  Sj(x)  g  X^. 

. ■  0(n),  then  T(F)  ■  {a)*  But  if  at  least  one  of 
is  not  0(n),  then  we  have 

T(F)  -  mnl(EE  (o,  oQ,  •  •  •,Op_1)  ), 


which  is  recognizable  by  1.15  and  3.6. 


If  F  is  a  Boolean  combination  of  principal  n-formulas,  then  we  need  merely 
note  that  the  recognizable  sets  are  closed  under  0,  IJ,  and  ~,  e.g.,  if  F  is 
G  v  H  and  T(G),  T(h)  are  recognizable,  then  so  is  T(F)  ■  T(G)  |)  T(H). 

Finally,  suppose  that  F  is  3  X^+1  G(x0',,*>xn)  and  T(G)  is  a  recognizable 
subset  of  L#  . .  Let  g  be  the  projection  of  E# .  into  E#  defined  by 
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g(<k0,...,kn»  -  <kQ,  ...,kn_1>  for  each  <kQ,...,kn>  €2n+l« 

Then  T(P)  ■  mnl(g(T(G))),  and  chit  is  recognisable  by  1.13,  1.1%  and  3.6. 

Tha  charaetarisatlon  of  the  recognisable  aata  davalopad  In  1.13,  1. 14,  and 
1.15  la  not  aaaantlal  to  tha  proof  of  3*7 — one  can  alao  glva  dlract  conatructlons 
of  traa  accaptora  II  auch  that  T(U)  ■  T(P)  for  aaeh  of  tha  various  forma  of  tha 
fonaula  7. 

COftOULAKY  3*8.  WS(3t  )  la  dacldabla  for  avery  flnlta  p. 

1  . .  ■  P 

flOOF.  If  F  is  an  arbitrary  santanca  of  Lp,  than,  by  3.4,  F  la  aqulvalant  to 
a  aantanca  F*  which  ia  in  normal  form.  F'  haa  at  laaat  ona  sat  variable; 
suppose,  for  example,  that  F'  is  3  X  G(X).  (In  case  F'  is  y  X  G(X),  we  consider 
Instead  3Xn  G(X)  —  1  F'.)  Now  F',  and  hanca  F,  is  a  member  of  US(9t^)  iff 
T(G)  is  not  empty.  But  T(G)  ■  0  is  effectively  decidable  by  Corollary  1.12. 

We  need  only  verify  that  F*  and  T(G)  can  be  effectively  obtained.  This  la 
accomplished  by  examination  of  the  proofs  of  3*^  and  the  results  In  Section  1. 

We  shall  devote  the  remainder  of  this  section  to  a  discussion  of  applica¬ 
tions  of  3.7,  deferring  consideration  of  the  many  applications  of  3*8  until 
Sections  4  and  % 

Theorem  3*7  has  a  converse:  Roughly  speaking,  "every  recognisable  set  can 
be  expressed  in  the  form  T(F)  for  some  formula  F."  This  statement  fails  to  be 
strictly  true  only  because  the  underlying  alphabets  of  the  sets  T(F)  are  not 
arbitrary,  but  azo  always  one  of  the  In  the  following  theorem,  we  restrict 
consideration  to  the  alphabets  ~  [0  n^},  denoted  by  in  order  to  avoid 


(  ) 


o 
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difficulties  associated  with  tl  -  ambiguities  In  the  representation  of  t squences 
of  sots  by  2^-traes.  Tho  ^  still  provide  alphabet*  of  arbitrarily  large  finite 
cardinality. 


THEOREM  3.9.  Every  aet  recognisable  over  some  alphabet  n  >  0,  can  be 
expressed  in  the  form  T(F)  for  soae  foreula  F. 


PROOF.  For  each  9  £  £q,  let  1°  be  ffi<Q  F^,  where  F^  is  x  £  ^  if  the  i-th  term 
of  9  is  1,  and  Fpx  £  ^  otherwise.  Similarly,  let  G*  be  TT1<ft  G^j  where  G^ 
is  Sj(sc)  £  X^  if  the  1-th  term  of  9  is  1  and  is  -1  S^(x)  e  X^  otherwise.  Put 

0(")  0(n> 

Hn»-,3x[F  A  n  TTj<p  Cj  ]. 

Then  H  (X  ,...,X  . )  holds  iff  the  minimal  tree  representing  X  ,  ...,  X  .is 

n  o  n—  1  0  n— 1 

a  tree  over 

Now  let  A  be  any  recognisable  subset  of  If  A  ■  #,  then  A  ■  T(Hn). 

If  A  ■  E^(®,o0,...,9p-1)  for  some  9,  oQ> •••>  ap-1  £  we  put 

F  ,  Hn  A  3  x[F»  A  Vp  «’1| 

and  then  we  have  A  ■  T(F).  In  case  one  or  more  of  the  9.  is  e,  we  need  merely 

a  0(n) 

replace  Gj  by  Gn 

Now  suppose  that  A  ■  B  fl  C  for  some  recognisable  sets  B,  C.  In  general, 
the  alphabets  for  B  and  C  may  properly  Include  However,  it  is  easily  seen 

that  we  can  find  m  2  n  and  recognisable  sets  B',  C'  over  ^  such  that 
P(A)  ■  B'  fl  C'  where  p  is  the  projection  of  ^  into  defined  by 


f 

l 
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■  (r0»  •  •  * *  *  *  *®> 

for  aach  (ro>'‘*»t|.j>  €  Thare  axlat  foruulaa  F',  P"  auch  that  T(P')  •  B' 
and  T(F")  ■  C'.  Wa  lat 

W.*-*-1*  st«  «  itl  a  r  a  »”], 

and  obtain  A  ■  1(F).  Tha  caaaa  A  •  I  u  C  and  A  •  B  —  C  ara  hand  lad  in  Ilka 
neanar. 

Finally  auppoaa  that  A  ■  p(B)  for  aona  projection  p  and  raoognlaabla  oat  B. 
Without  loaa  of  generality,  wa  way  aaauna  that  tha  wndarlylns  alphabet  af  B  la 
aona  a  a  n.  Ihara  axlata  a  fonmla  6  •  C(Xfl,....XM  awch  that  T(G)  ■  B. 
lat  To#  Ta  ^  ha  dlatlnct  naw  variable a  which  do  not  occur  In  C,  and  pat 

F  nl^  ...  I  ^.itc(X0»  -»Vl)  A  V5(V^(f0(V*,,»U-l) 

/>(«)  >(a) 

(r  (y0»«« **  F  |))])* 

Than  T(F)  •  A. 

Thaoroa  3.9  now  follow*  fron  1.1% 

COBOILABT  3.10.  A  aubaat  L  of  ^  la  a  context-free  language  If  ud  only  If 
L  ■Q(f(F(«#,...,I||.l)))  for  aona  focwuU  F. 

A  aubaat  X  c  la  weak  eecond -order  da  finable  la  If  for  aona  forwula 
F(«)t  with  exactly  tha  ona  fraa  Individual  variable  1,  X  la  tha  act  of  1  ( 
auch  that  f(i)  holda  under  tha  weak  interpretation.  Wa  a ay  than  that  X  la 
defined  by  F  la  X^s  olnliarly,  wa  apeak  of  eubecte  of  W^  x  ae  defined  by 
foraulao  F and  ao  on. 
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COftOUAKY  3.11.  A  subsat  of  M_  l*  vuk  second-order  daflnlabla  In  JL  it  and 
1  ■  ■  P  P 

only  If  lc  It  rogulor. 

HOOF.  Xn  vlw  of  3.7,  3*9,  1.16,  and  eho  rmrk<  «c  Cho  tnd  of  Soetlon  1,  wo 
nood  only  show  chat,  for  any  formula  F  with  exactly  cha  frat  varlablas 
*<,>••••  !«-!»  UTrt(r)Mt)  la  definable  In  9^.  Xn  fact.  If 

«<!>!. . s~i>  •  £k.';  *  S|J A  nK.,x,^  !j(;) « ill. 

than  UT<T(f/  fr(t)  la  defined  by 

-  *0  •**  ^  A  |))» 

Xa  thla  paper  w  hava  ldaotlflad  chraa  distinct  Mthods  of  deflniM  • 
racofniaabls  sac  A  c  a  >  0:  A  asy  ba  expressed  in  any  of  tha  forma 

(X)  Tbs  rasult  of  a  finite  sequence  of  applications  of  yrojactlona 
aad  >00 loan  sat  operations  storting  with  aats  of  tha  form 

(XI)  T(V)  for  sons  traa  accaytor  1; 

(XII)  T(F)  for  som  formula  F^, of  ly 

Tha  so  My  ba  coops  rad  with  tha  following  nsthods  of  da  fin  Inf  a  ragular  sat 
•  c  (s^.mjS^j)*  :  I  My  ba  aayrassad  in  any  of  tha  fonm 

(II)  Tha  rasult  of  a  finite  sequence  of  applications  of  tha  oparatlooa 
*  ,  •  ,  ij  ,  0,  and  -  starting  with  finite  sate  of  words; 

(III)  T(tf)  for  som  finlta  autoMton  e|; 

(III')  (a  :  F(x)l  for  som  formula  F(x)  of  L  . 
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The  equivalence  of  the  forms  of  definition  (I),  ( II) ,  end  (111)  hae  been 
aatabllehed  in  this  paper  by  1.14,  1.15,  3*7,  and  3.9,  while  the  equivalence 
of  (X'),  (II'),  and  (III')  la  a  consequence  of  well-known  resulte  In  the 
literature  and  Corollary  3. 11.  Irani  net  Ion  of  the  proofs  of  these  equivalences 
discloses  that  each  of  tbasi  la  completely  effective. 

IHHA  3.12.  (1)  If  a  definition  of  a  recognisable  set  A  c  10  0,  le  given 

In  one  of  the  forms  (I),  (XI),  (Ill),  then  definitions  of  A  in  each  of  the  other 
two  forms  can  be  effectively  obtained. 

(11)  If  e  definition  of  a  regular  eat  B  c  B  ,  p  >  0,  la  given  In  one  of 

r 

the  forme  (I'),  (XI'),  (XXX'),  then  definitions  In  each  of  the  other  two  forme 
can  be  effectively  obtained. 

In  [1]  Buchl  considered  the  “very  weak  second-order  theory"  of  9p,  In 
which  the  set  variables  range,  not  over  erbltrery  finite  subsets  of  Bp,  but 
only  over  thoee  finite  subsets  which  are  chelae  with  respect  to  the  Initial 
signs  nr  relation.  Theorem  10  of  his  paper  states  that  the  class  of  subsets 
of  Bp  definable  In  the  very  weak  second-order  theory  coincides  with  the 
regular  rheete  of  Bp.  Thus  we  see  that,  from  the  point  of  view  of  defining 
subsets  of  Bp,  the  weak  second-order  theory  Is  no  more  powerful  than  the  very 
weak  second-order  theory. 
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SECTION  4.  APPLICATIONS 

In  chi*  section  vi  shall  apply  tha  results  of  Section  3  to  establish  tha 
decidability  of  a  variety  of  weak  second-order  theories.  The  seas  general 
aethod  will  be  used  In  nearly  all  caaes:  the  decidability  of  US(V)  la  proved 
by  Interpreting  WS(tl)  into  WS(9p)  for  sons  p  (usually  p  ■  2).  This  Interpre¬ 
tation  la  baaed  upon  a  definition  In  WS(1  )  of  a  substructure  of  9  lsoaorphlc 

P  P 

to  the  given  structure  9.  Por  exanple,  If  9  ■  (4,0,1)  where  0  Is  a  binary  opera¬ 
tion  and  R  la  a  binary  relation,  and  there  are  fornulas  F(x),G(x,2,s),  H(x,{)  such  that 

%m  <A\0',R'> 

where 

x  f  A  Iff  P(x)  holds  In  9p, 

0'(x,y)  •  s  iff  C(x,y,s)  holds  in  9p, 

R'(x,y)  iff  H(x,y)  holds  In  9p 

then  we  say  that  the  triple  <F,C,H)  la  a  weak  second-order  definition  of  9  In 
9p.  It  follows  fron  the  existence  of  such  a  definition  that  WS(9)  la  lnterpre- 
uble  In  and  hence  that  Ml(9)  Is  decidable.  (For  further  infornstlon 

on  Interpretation  of  theories,  the  reader  nay  consult  [23].) 

TfgQREH  4.1.  For  each  finite  p  >  0,  9^  Is  weak  second-order  definable  In  % 

PROOF.  Let  A  •  {[•)  •  Then  A  Is  a  regular  sat,  and,  by  3.12, 

a  fornula  F(x)  defining  A  In  9g  can  be  effectively  obtained.  Let  the  terns 
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$n#  n  <  Wf  be  defined  4y  recursion:  fo(*)  ■  x,  ♦^(x)  ■  §jUn(*))  *or  *xch 
n.  Putting  Cj(x,^)  •  jr  W  {^(^(x)),  vo  have  that  <F,G0,  ...,G^>  la  a  defini¬ 
tion  of  9p  In  j^. 

V 

Lat  *  (ao,a^i..}  j  for  x  £  and  n  <  %  lot  SQ(x)  ■  xa^,  and  lot 
9t0  "  (M^S^,...).  Thera  la  a  fornula  Fjx)  doflnlnf  the  regular  aat 
(1*1  *  (M*)*#  •**  l*  "•  lat  Cj(x,jr)  be  aa  In  the  proof  of  4.1,  we  find  that 
(T  .0  #0  , ...)  la  a  weak  eecond*«rder  definition  of  9  In  JL,  and  hence, 

Or  0  1  (D  c 

WS(9 J)  la  decidable. 

Wdl^)  la  not  aa  rich  a  theory  aa  one  night  wlah;  for  exaaplo,  even  the  elaple 
relation  "x  •  la(y)  for  bom  n"  la  not  definable  In  It.  Wo  can,  however,  add 
a  further  relation  to  9^  and  obtain  nore  oat la factory  reeulte  Lat  la(x,y) 
hold  Iff  x  la  an  Initial  aegnont  0/  y,  and  put  9^  •  (X ^Ie,#^*^,...). 

TWOUH  4.2  (1)  9 *  la  weak  aocond -order  definable  In  9g  and  hence  WS(9^)  lo 
decidable. 

(II)  For  each  p  >  0,  9p  la  weak  aocond -order  definable  In  9^* 

(III)  k  aet  X  c  (a#,...,a  la  regular  If  and  only  If  It  la  weak 

eecond-orier  definable  In  9'  • 

v 

HOOF,  k  definition  of  9^  In  92  la  <F^X,C0,Cl,...>  where  Qq,  Cj,  ...  are 
aa  above  aod  I(x,j)  la 

V  XCjr  f  X  AV  *[*0(«)  Mv  S^a)  f  ?  -  »  C  ?)  -  *  f  ?)  A  Fjx)  a  FjCjr). 
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To  prove  part  (11),  It  la  aufflclent  to  note  that,  for  each  p  >  0,  the 

formula 

V  -  l  m  2  V 

f 

defines  the  set  fa  ,...,a  .}  om  51  . 

*•0  P~1  UJ 

Let  the  mapping  f  :  {aQ,a^, . . .  «*  {a,b}#  be  defined  by  f(a^)  ■  ab^ 

J  ■  0,  1,  ...  and  f(uv)  ■  f(u)f(v)  for  all  words  u,  v.  (f  Is  simply  the 

Isomorphism  which  establishes  that  9^  is  defined  In  Jig  by  (P^  T,G0, •••)•)  Assume 

p  >  0,  and  let  fp  be  the  restriction  of  f  to  {ao, . . •  A  generalised 

sequential  machine  (as  defined  In  Glnsburg  and  lose  [16]),  which  effects  the 

mapping  f  can  easily  be  constructed,  so  that,  by  a  theorem  In  [16],  a  set 

X  c  [a  ,...,a  .}  Is  regular  if  and  only  If  f  (X)  is  regular.  Mow  we  note 
o  p*i  p 

the  following  two  properties  of  the  definitions  of  9'  In  JL  and  of  9  In  9* : 

«  c.  p  w 

(1)  If  X  Is  definable  In  then  f(X)  Is  definable  In  9gi 

(2)  if  X  Is  definable  In  9^,  then  X  Is  definable  In  9^» 

* 

Suppose  that  X  c  [ao, . .  .,0^}  •  If  X  Is  regular,  then  X  Is  definable  In  9^, 

so  by  (2),  X  Is  definable  In  9^<  Conversely,  If  X  Is  definable  In  9 ^  then, 

by  (1),  f(X)  ■  f  (X)  Is  definable  In  %>•  But  this  laplles  that  f  (X)  Is  regular, 
P  «  P 

whence  X  Is  regular  also. 

Theorem  4.2  (1),  In  a  somewhat  different  form,  was  obtained  by 
J.U.  Thatcher  [26].  Theorem  4.2  (ill)  Improves  3*H  by  giving  a  single  decidable 
theory,  WS(9^),  within  which  every  regular  set  msy  be  defined  (subject  to  the 
restriction  that  the  underlying  alphabet  be  a  subset  of  (ao,a^,...l). 
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Let  or  be  eny  order  type.  By  WS(cr)  we  mean  WS(tl)  where  fj  ■  <A,R)  li  any 
relational  structure  such  that  R  is  an  order  relation  on  A  of  type  or.  The 
notion  of  (weak  second-order)  definability  is  extended  in  the  natural  way, 
l.e.,  e  type  9  is  definable  in  JRg  if  sobm  structure  tl  of  type  9  is  definable 
In  J^.  All  the  definitions  of  order  types  in  3tg  we  give  will  be  with  the  aid 
of  the  following  ordering  of  Hg* 

DKFIMTIOM  4.3.  The  laft-to-rliht  ordering  of  Mg  is  the  relation  <,  defined 
in  the  weak  second -order  theory  by  the  formula 

*  <  i  ■  v  x(!|(s)«z)  v  s  •C1(!0(*)»*)  A  I(*l(*)#r>3- 

To  understand  the  nature  of  the  Nleft-to-rlght  ordering,"  it  nay  be 
helpful  to  draw  a  graphic  representation  of  Mg,  similar  to  Figure  1.  For 
x,  7  €  *•  have  x  <  y  iff  the  branch  to  x  procedes  leftward  from  some  point 

on  the  branch  to  y  (possibly  y  Itself),  or,  equivalently,  the  branch  to  y 
procedes  rightward  from  some  point  on  the  branch  to  x. 

For  eny  class  8  of  order  types  let  C(8)  be  the  closure  of  8  under  the 
order-type  operations  +  (addition),  •  (multiplication),  and  *  (converse).  T) 
is  the  type  of  the  rationale. 

TWOtiW  4.4.  If  8  •  U  (0,1,...)  and  o  c  C(s),  then  9  is  weak  second- 

order  definable  in  3^,  end  hence,  US(o)  is  decidable. 

HOOF.  We  shall  show  how  to  obtain,  for  each  9  f  C(8),  e  regular  set 

i  CL  which  la  ordered  of  type  9  by  the  left-to-rlght  ordering,  <,  end  which 
or  — 

satisfies  the  additional  condition 

(1)  if  x,  y,  f  A  then  x  is  not  an  initial  segment  of  y. 
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For  each  n  <  u>,  let  Ar  ■  (b0*, ...,bn  *a],  let 

Au>  “  Cb}*  *  W  4nd  %  “  {*Mbb}*  ‘  £»}• 

If  A^,  Ap  have  been  obtained,  then  A^  ■  ({•}  *  A^)  IJ  ({b}  •  A^)  and 

A  .  ■  A  •  A.  •  A-  ■  f (A  ) ,  where  f  la  the  projection  of  N0  onto  NL  such  that 

or*  8  or  8  a  '  o"  r  J  2  2 

f (a)  ■  b  and  f(b)  ■  a.  It  la  easily  verified  that  If  A  ,  A.  satisfy  (1),  then 

or  p 

A  A  Q,  and  A «  also  satisfy  (1).  The  proof  is  completed  by  Induction, 

Onp  Of*P  O 

showing  that  each  A^,  a  f  C(s),  is  Indeed  ordered  of  type  a  by  <  (the  condition 

(1)  Is  needed  In  the  case  A  „). 

u  8 

The  improvement  made  by  Theorem  4.4  over  results  known  prior  to  the 
publication  of  [7]  Is  simply  the  Includlon  of  *  In  the  set  S» 

Let  us  say  of  two  order  types  a,  B  that  a  ■  n$  if  WS(o),  WS(e)  contain 
the  same  sentences  with  n  or  fewer  qualifiers.  Thus,  WS(o)  ■  WS(&)  Iff 

O 

0  ■  n8  for  every  n.  In  [9],  Ehrenfeucht  gave  a  condition  —ve  denote  It  by 


‘The  condition  ^(0,8)  Is  defined  as  follows:  Ve  isuglne  a  game  between  two 
players,  1  and  II.  In  the  first  move,  player  I  selects  one  of  the  order  types 
0,8  and  chooses  a  finite  sequence  of  types  which  are  initial  segments  of  this 
one,  and  player  II  responds  with  an  equally  long  sequence  of  Initial  segments 
of  the  other  of  or,8i  e.g.,  1  chooses  80»***»Bk<  8>  end  II  responds  with 
o0»...,oy  <  or*  in  succeeding  moves,  the  two  players  repeat  this  process, 
extending  the  sequences  already  obtained.  Player  II  wins  If,  after  n  moves, 
the  resulting  sequences  are  order  Isomorphic;  otherwise  player  I  wins.  The 
condition  £n(or,&)  holds  Just  In  case  player  II  has  a  winning  strategy 
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which,  when  modified  to  apply  to  order  types  Instead  of  structures,  yields  the 
following: 

For  any  two  ordinals  or,  0,  If  6n(ar,0),  then  a  ■  n0. 

Shrenfeucht  also  showed  that  If  a  Is  atqr  ordinal  then,  for  each  n,  there  exists 
or'  <  such  that  f^(or,o')«  It  Is  not  difficult  to  show  that  the  operations 
+,  •,  and  v  preserve  the  condition  &n;  namely,  for  any  order  types  a,  o'# 

0,  g',  If  en(a#3)  Cn(o',p')  then  Sn(  <*♦»',  0+0'),  en(or  •  or’,  3  •  p'),  and 

£^(flr,3).  In  this  way,  we  obtain 

COROLLARY  4.0.  Let  Oft  denote  the  class  of  all  ordinals.  If  a  €  C(Oft  u  {*}), 
then  Wl(a)  Is  decidable. 

Corollary  4.5  Improves  a  result  In  the  literature  (see  [3],  [11],  and 
[9])  by  which  Ut(ar)  1'  decidable  for  every  ordinal  <y.  In  [12]  It  Is  stated 
that  Shrenfeucht  had  obtained  e  decision  method  for  the  theory  of  ordinal 
addition;  from  this  result,  the  decidability  of  VS(ar)  for  every  ordinal  o 
follows  at  once  by  Theorem  10.1  of  [12].  Shrenfeucht  never  published  hie  proof, 
however;  and  later,  e  proof  of  these  results  was  published  by  Buchl  [3]. 

As  this  peper  was  being  written,  the  euthor  learned  (by  personal  cosmunlca- 
tlon)  that  M.O.  Babin  had  found  a  proof  of  the  decidability  of  SS(Jt).  (This 
proof  has  elnce  been  published  in  [22].)  It  Is  worth  noting  that  ell 
our  theorems  concerning  definability  of  order  types  continue  to  hold  In 
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the  context  of  the  strong  second-order  theory.  (To  show  this,  one  has  only 
to  exhibit  e  formula  F(x)  such  that  for  X  c  Ng,  F(X)  holds  In  the  strong 
Interpretation  Iff  X  Is  finite.)  Because  every  denumerable  order  type  can 
be  embedded  In  the  rationale,  Rabin's  result  at  once  yields,  as  he  has  pointed 
out,  the  decidability  of  the  strong  monadic  second-order  theory  of  countable 
linear  orderings,  thus  considerably  improving  a  result  of  Buchl  [4],  to  the 
effect  that  the  corresponding  theorem  holds  for  countable  vell-orderlngs. 


I 
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SECTION  5.  DECISION  FROBLPS  OF  LOCALLY  FRII  ALQEBEAB 


In  this  Motion  w«  •hall  Apply  Corollary  3.8  to  prove  the  decidability  of 

tha  waak  second-order  thaory  of  a  general  elaaa  of  structural  which  includes 

tha  91  as  particular  eases.  We  neks  essential  use  of  Buchi's  theorem  on  tha 
P 

decidability  of  88(91^)  [2],  and  of  the  generalised  products  of  Feferman  and 
Vaught  [12]. 

Lot  V  ■  (A,0  . ...,0  .,R  , ...,R  .)  be  an  algebraic  structure.  If 

O  O  ^“1 

d  t  A'  C  A,  then  €^(A' )  denotes  the  subalgebra  of  V  generated  by  A' :  Namely, 
C^(A')  ■  <A",0^,...,0^_l,R^,...,t^_1>  where  A"  is  the  least  set  containing  A' 
and  closed  under  the  operations  0o,..«,0  and  each  of  OJ,  RJ  are  the  restric¬ 
tions  of  0^,  Rj,  respectively,  to  the  set  A".  In  case  A'  consists  of  a  single 
element,  l.e.,  A'  ■  (x),  we  write  f^(x)  ■  <*y(A'). 


If  Q  Is  any  class  of  algebraic  structures  of  a  given  similarity  type,  then 
WS(a)  Is  the  set  of  week  second-order  sentences  true  In  every  element  of  0.  A 
Mntence  Is  true  In  a  If  It  is  true  In  every  member  of  a*  If  T  Is  any  set  of 
sentences  in  a  language  L,  then  VS(T)  ■  WS(a),  where  a  Is  the  class  of  structures 
II  having  the  seme  type  as  L  and  such  that  T  c  WS(l).  Interpretations  similar  to 
these  apply  to  the  not  let  ions  88(a),  ET(T),  etc. 

Let  I  be  any  nonempty  set  and  let 

i  €  I,  be  algebrelc  structures  of  the  same  similarity  type,  indexed  by  elements 
of  the  set  I,  such  that  the  A^  are  pairwise  disjoint.  Ihe  cardinal  irn  of 
the  Is  the  structure  if  •  (M>o,...,0  j,R0,...,I  j>  where  A  *  U^jA^, 

°J  *  4fl°j1^  *  "  °*  •••»  P“l»  *  J  *  °*  •••#  B-l*  case 


e  •  • 
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the  universes  of  the  ere  not  disjoint,  then  we  understand  their  cardinal  sum 
to  be  the  cardinal  sun  of  a  set  of  structures  11^,  1  £  I,  with  tlj,  *  Uj,  for 
each  1,  which  do  have  mutually  disjoint  universes. 

Let  p  >  0  and  let  L  be  the  language  with  only  the  operation  symbols 

2o*  •••'2p-i*  2i  \  *°r  *  ■  0#  •••#  P“l*  [17]#  Mal'cev 

considered  the  elementary  theory  based  upon  the  axlome 

4»2j(Zt,***,Jfnj^  0  a  1<  J  <  p, 

ni 

(!)  2i(V*'5nt)  *  ”  Wj-1^5j  0  a  l  <  p, 

x  4*  f(x)  for  every  tern  {  with  et  least  one  occurrence  of  x. 

Structures  setlsfylng  the  ax  lone  (l)  ere  called  locally  free  algebras  over  the 
0o,  Is  denoted  by  X*  Mal'cev  showed  that  ET(X)  Is  decidable.  On  the 

other  hand,  Tarski,  see  [24],  has  established: 

If  n^  i  2  for  at  least  one  1,  the  W5(x)  la  undecidable. 

In  this  section  we  shall  consider  WS(X)  under  the  assumption  •  1  for  each  1; 
l.e.,  X  Is  the  class  of  locally  free  algebras  over  p  unary  operations.  Here¬ 
after  ell  the  operations  0^  are  assuswd  to  h*  unary;  to  emphasise  this,  we  will 
use  the  symbols  Instead  of  0^.  Moreo/er,  we  shall  assusm  p  •  2;  this  la  done 
merely  for  notational  convenience,  and  the  reader  will  encounter  no  difficulty 
should  he  wish  to  undertake  the  tedious  job  of  revising  our  theorems  and  proofs 
so  as  to  apply  to  arbitrary  finite  p.  The  monadic  second-order  language  with 
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just  the  two  unery  operation  symbols  S^,  is  denoted  simply  by  L.  Under 
these  assumptions,  £  becomes  the  class  of  nonempty  structures  of  type  ((1,1  )> 
satisfying  the  axioms 

(II-l) 

( II-2 ) 

(II-3)  x  4<  t(j)  *or  every  term  f  with  at  least  one  occurrence  of  x. 

We  shall  see  later  that  the  schema  ( II— 3 )  can  be  replaced  by  a  single  weak 
second-order  axiom. 

Let  X  be  the  class  of  structures  satisfying  (II-l),  (II-2)  alone.  The 
elemnts  of  X  will  be  called  x-algebras.  We  shall  show  that  WS(x)  is  decidable 
and  obtain  the  decidability  of  WS(£)  as  a  corollary  of  this  result.  Our  first 
step  will  be  to  conduct  a  mathematical  analysis  of  the  structures  in  the  class 
X*  This  analysis  will  be  used  in  subsequent  ms tama theme tlcal  arguments  to 
reach  the  desired  goals. 

DEFINITION  5.1.  A  X-algebra  tl  is  simple  if  for  every  x,  y  €  |tl|  there  exists  a 
z  such  that  x,  y  £  .  (r);  if  in  addition  there  e'xists  an  element  z  such  that 
31  ■  (s),  then  tl  is  generated  and  z  is  called  a  generator;  if  there  is  no  such 

z,  then  tl  is  ungenerated .  The  class  of  simple  K-algebras  is  denoted  by  X#> 
and  its  subclasses  of  generated  and  ungenerated  algebras  by  Xg  and  X^; 
respectively. 

The  term  "generated"  and  "ungenerated"  apply  only  to  simple  X**lgebras. 

To  avert  confusion,  however,  we  sometimes  redundantly  refer  to  X-algebras  as 
"generated  simple"  or  "ungenerated  simple." 


24  July  1967 


57 


tm-73 8/035/00 


THEOREM  5.2.  An  algebra  la  a  K-algebra  if  and  only  if  it  is  a  cardinal  aum 
of  simple  X-algebras. 

PROOF.  That  a  cardinal  sum  of  K-algebras  is  again  a  K-algebra  is  immediate 
from  axioms  (II-1),  (II-2).  New  let  SI  ■  (*,S  »S^>  £  K;  for  x,  y  £  A,  we  write 
x  —  y  if  there  exists  z  £  A  such  that  both  x,  y  are  members  of  l€^(z)|* 

Clearly,  —  is  an  equivalence  relation.  For  any  x  e  A,  let  x  be  the  equivalence 
class  of  x,  and  let  A  ■  {x  :  x  £  A}.  If,  for  any  x  f  A,  we  let  t^.  ■  (x,S^,S* ) 
where  S^,  S  j  are  the  restrictions  of  Sq,  to  x,  then  SI  is  the  cardinal  sum 
of  the  SIg,  x  €  A. 

Henceforth,  when  we  say  that  ^  is  a  term,  we  mean  that  f  is  a  term  in  the 

language  L.  The  rank  of  \|r  is  denoted  by  |f|.  The  composition  of  two  terms 

^  -  S.  ...S  (x),  x  ■  S  ...S  (y)  is  denoted  simply  by  concatenation: 

o  n-1  “  "J0  "Jm-1 

^rx  i»  . ..S^  S  • . . S  ,  (jr).  We  say  that  ^  is  a  prefix  of  ^  and  x  is  a 

o  n-1  Jo  Jm-1 

suffix  of  ^x«  ^  is  ty  itself,  and  for  finite  nil,  Given  a 

structure  91  *  (A,So,S^)  and  x,  y  £  A,  we  write  x  ■  f(y)  Just  in  case  F(x,y) 
holds  in  SI,  where  F(x,g)  is  the  formula  x  «  f(jr). 

LEMMA  5.3  (Cancellation  Law).  Let  <p,  x>  ♦  be  any  terms. 

(i)  V  x  V  xC<Px(s)  «  tpt(x)  -  x($)  «  if(z)]  is  true  in  X. 

(ii)  If  ^  has  a  prefix  \|r'  of  the  same  rank  as  x  and  f  f",  then 

V  X  V  jr[x(x)  «  i'(z)  '(2)]  i®  true  in  K. 
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PROOF:  From  (II-l),  (11-2)  by  induction  on  the  rank  of  the  term  cp  in  (l)  and 
X  (“)• 

LEMMA  $.k.  Let  U  be  a  generated  simple  K-algebra.  If  for  some  u  €  | tl(  and 
some  term  ji  of  L,  |  >  0  and  u  ■  f(u)  then 

(I)  u  is  a  generator  of  91; 

(II)  if  x  £  1 9j |  and  x  ■  ^(x)  for  some  nontrivial  term  ^  of  L,  then 
x  ■  ^'(u)  for  some  suffix  t'  of 

PROOF.  Let  y  be  any  generator  of  U,  and  let  cp  be  a  term  such  that  u  *  cp(y). 
There  is  a  finite  n  such  that  |fn|  2  |cp|.  Now,  fn(u)  ■  cp(y)  also,  so  by 
5.3  (ii),  y  ■  t'(u)  where  f 1  is  a  suffix  of  fn.  It  follows  that  u  is  also  a 
generator  of  9j. 

Now  consider  part  (li).  From  (i)  we  have  that  both  u,  x  are  generators 
of  K.  Say  u  ■  <p(x);  we  then  have  yn(u)  ■  cp(x)  for  every  n.  If  |qj|  s  |j|, 
then  we  take  n  •  1  and  have,  by  the  cancellation  law,  x  ■  t'(u)  for  some 
suffix  of  If  |  cp|  >  It],  let  n  >  1  be  such  that  It”  *|  <  |  cp|  s  |  i(r  *  I  • 
Applying  the  cancellation  law  to  the  equation  tn(u)  "  cp(x),  we  again  obtain 
that  x  ■  t'(u)  for  some  suffix  t'  of 

Figure  2  la  a  tree  diagram  of  an  element  9J  -  (A,Sq,S^)  of  K>  Here  the 

* 

universe  is  the  set  A  *  [e,b]  |j  ({a,ba}  •  (a,b)  ),  and  the  two  operations  are, 
for  all  x  f  A,  SQ(x)  ■  xa,  S^x)  ■  xb  if  x  +  b,  and  S^b)  ■  €.  The  structure 
9(  shown  satisfies  the  equation  S^(€)  ■  e. 
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Figure  2.  Diagram  of  a  K-Algebra. 

If  a  generated  K-algebra  also  satisfies  the  axioms  (II-3)  (i.e.,  it  falls 
to  satisfy  the  hypothesis  of  5'k),  then  it  is  isomorphic  to  Dig*  Thus,  the 
Impact  of  Lenina  5.4  is  that  a  generated  X-«lgebra  is  either  isomorphic  to  «Jlg 
or  has  just  one  "loop."  This  is  expressed  in  the  following: 

THEOREM  5.5.  Two  generated  K-algebras  91,  8  are  isomorphic  if  and  only  if  either 

(i)  each  of  SI,  8  is  isomorphic  to  Dig 
or  else 

(ii)  there  exists  a  nontrivial  term  \|i  such  that  3  x[x  «  ^r(x)]  holds  in  . 

both  SI  ,  8  y  while  for  any  nontrivial  proper  suffix  of  ty,  I  x[x  »  ^'(x)] 

fails .  in  both  SI,  8. 

Notice  the  one-to-one  correspondence  between  terms  and  words  over  {a,b}: 
a  term  ^  corresponds  to  its  value  ty(e)  in  the  particular  K-algebra  Dig*  We  thus 
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establish  a  many-to-one  correspondence  between  words  over  {a,b}  and  the 

Isomorphism  classes  of  generated  X-algebras;  the  empty  word  corresponds  to  the 

class  of  algebras  Isomorphic  to  And  the  other  classes  are  determined  by 

words  distinct  from  e:  given  an  Isomorphism  class  not  containing  3lg,  let 

if  ■  .  ..,Si  (x)  be  a  term  such  that  the  condition  of  5.5  (li)  is  satisfied 

' o  n  # 

by  every  structure  in  the  class;  then  the  word  j/(e)  e[a,b}  corresponds  to 

this  class.  IWo  words  u,  v  determine  the  same  Isomorphism  class  if  and  only  If 

there  exist  words  u',  u"  such  that  u  ■  u'u"  and  v  ■  uMu'. 

Let  pred(x,2)  be  the  formula 

SQ(x)  »  1  v  Sx(x)  «  i- 

If  y  £  j?l|  for  some  K~algebra  91,  there  is  at  most  one  x  such  that  pred(x,y) 
holds  in  91  (although  there  may  not  be  any  such  x,  e.g.,  if  91  ■  SRg  an<*  y  ■  0* 

If  there  Is  an  x  such  that  pred(x,y)  we  denote  it  by  pd(y);  otherwise,  we  let 
pd(y)  "  y*  We  now  put 

pd°(y)  -  y 

pdn+1(y)  “  pd(pdn(y)) 

for  each  finite  n. 

DEFINITION  5.6.  Let  91  be  any  ungenerated  simple  K-algebra.  A  descriptor  of 
9(  is  any  set  M  of  natural  numbers  such  that  for  some  x  f  |9j| , 

M  “  x  "  ln  •*  P^n(x)  -  SQ(pdn+1(x))}. 

THEOREM  5*7*  Let  91,  93  be  any  ungenarated  simple  X-slgebra. 

(i)  If  x  f  | tl | ,  then  ^j(x) 
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(li)  If  x,  y  £  |5l|  then  there  exist  Integers  m,  n  such  that,  for  each  k, 

m  +  k  £  M  if  and  only  if  n  +  k  f  M . 

21>  x  vi,  y 

(iii)  21  ^  S  if  and  only  if  21  and  3  have  identical  desciptors,  i.e.,  there 
exist  x  e  \W\,  y  €  I®!  «uch  that  M^x  -  M^y. 

PROOF.  If  x  g  |2l|,  then  Sy(x)  is  a  generated  simple  x  algebra.  Suppose  6^(x) 
is  not  isomorphic  to  SRg.  Then  by  5.5  (ii),  there  is  a  nontrivial  term  i|r  and 
a  u  c  (s^x)  |  such  that  u  ■  \|i(u).  Let  y  £  |2l|;  then  for  some  z  £  |2l|, 
u,  y  £  |®^(z)|  .  Since  a  ■  ^(u),  we  have  that  u  is  a  generator  of  6^(z)  ^ 

5.4  (i);  hence  y  f  |6„j(u)|.  Since  y  is  arbitrary  in  |!l|,  it  follows  that 
lilt  c®^(u)*  But  this  contradicts  the  hypothesis  that  21  is  ungenerated. 

If  x,  y  f  |II|,  let  z  be  such  that  x,  y  c  S^(z),  say  z  “  pdn(y).  Then 
pdm+^(x)  *  pdn+k(y)  for  every  k;  hence,  m  +  k  c  y,  for  k  *  0, 1 . 

Finally,  we  consider  (iii).  The  "only  if"  part  is  obvious.  Let  x  f  |9j|, 
y  f  |58|  be  such  that  y.  Now  |9lj  consists  of  the  following  disjoint 

subsets 

Ax  -  !%<*)|, 

Bx  *  {pdn(x)  :  n  <  m), 

and  for  each  n, 

Cx,n  "  lS,,(5l(p<in+1(x)))l  lf  n  <=  \x’ 

■  le*,,(so(pdn+1(x)))| 


otherwise. 
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Similarly,  |9J|  consists  of  disjoint  classes  Ay,  By,  n,  n  ■  0,  1,  2,  ...  . 

We  then  have  ~  ^(Ay)  and  €^(C  )  a-  ®s(cy>n)>  n  “  °>  •••»  since> 

by  (l),  all  of  these  structures  are  isomorphic  to  JRg.  Let  the  function 

f  :  |fjj  -*  |SB|  be  defined  as  follows.  On  A^,  f  is  the  natural  isomorphism  mapping 

A  to  A  ,  ard,  similarly,  on  each  C  ,  f  is  the  natural  isomorphism  mapping 

x  y  x  y  n 

C  to  C  ,  n  ■  0,  1,  ...  .  On  B  ,  we  put 

x,n  n,y7  ’  ’  x’  v 

f(pdn(x))  ■  Pdn(y)>  n  -  1,  2,  ...  . 


That  f  is,  in  fact,  an  isomorphism  of  91  onto  S3  now  follows  from  M^  ^  y. 

Figure  3  is  a  tree-like  diagram  of  an  ungenerated  K-algebra.  The 
descriptor  associated  with  the  element  x  Indicated  is  {0,3,6,...}. 


Theorem  5.7  shows  that  each  ungenerated  K-algebra  is  determined  up  to 
isomorphism  by  a  single  subset  of  the  natural  numbers.  Two  such  sets  lead  to 
the  same  algebra  if  and  only  if  "ultimately,  one  is  a  translation  of  the 
other,"  in  the  sense  of  5.7  (ii). 


Theorems  5.2,  5.5,  and  5.7  provide  a  comprehensive  analytic  description 
of  the  X-algebras.  We  now  turn  to  the  application  of  this  description  to  the 
decision  problem  for  WS(K). 

LEMMA  5*8*  Each  of  the  theories  WS(k_)j  WS(K_),  WS(x..)>  and  WS(£)  is  finitely 

8  5  U 

(semantically)  axiomatizable. 

PROOF.  The  required  axioms  will  be  formulated  with  the  aid  of  some  special 
formulas  (in  addition  to  those  already  defined,  e.g.,  pred  (x,^)): 

Clpd(x,x)  =  V  u[u  4,  x  A  u  f  X  -■*  V  v[pred(v,u)  ->  v  £  X]] 

Sal(x,£)  =  3  X[^  f  X  A  Clpd(x,X)]  A  V  X[^  f  X  A  Clpd(x,X)  -*  x  £  X] . 


Figure  3.  Diagram  of  an  Ungenerated  K-Algebra. 
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Thus,  Clpd(x,X)  holds  in  a  K-algebra  9J  just  in  case  the  predecessor  operation, 
pd,  maps  X  ~  [x]  Into  X.  An  elementary  argument  shows  that  for  any  x,  y  f  |9I|, 
Sal(x,y)  If  and  only  if  y  £  £^(x).  (Notice  that  this  equivalence  remains  true 
under  the  strong  interpretation.)  From  this  it  follows  that  the  class  of 
X-algebras  satisfying 

(1)  v  x  V  l  3  z[Sal(z,x)  A  Sal(z,y)] 

coincides  with  K  ,  the  class  of  simple  K-algebras.  The  subclasses  K  ,  K  ,  of 

8  ^  U 

K  are,  respectively,  characterized  by  the  additional  axiom 
8 

(2)  3  x  v  l  Sal(x,y), 

or  its  negation.  Finally,  we  note  that  the  axiom  schema  (II-3)  is  equivalent 

to  the  single  weak  second-order  sentence 

(II-4)  -1  3  X  3  y[x  4=1  z  A  Sal(x,y)  A  Salty, x)], 

so  that  the  class  £  of  locally  free  algebras  is  determined  by  the  axioms  (II-1), 
( II-2 ) ,  ( II— 4) . 

Theorem  5*5  and  the  remarks  following  it  indicate  a  correspondence  between 
words  over  {a,b},  i.e.,  elements  of  Ng  and  the  isomorphism  classes  of  generated 
K-algebras.  Our  proof  of  the  following  theorem  is  based  on  an  implementation 
of  this  correspondence  in  the  weak  second-order  language.  Namely,  we  exhibit 
weak  second-order  formulas  which,  relative  to  any  word  u  in  |3lg|,  define  in  3l2 
a  simple  generated  K-algebra  belonging  to  the  isomorphism  class  corresponding 
to  u. 

THEOREM  5.9.  WS(K  )  is  decidable. 

— — - — -  g 
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PROOF.  Let 

F(u,x)  =  -1  Sal(u,x)  v-i3  ;  pred(z,u) 

G0()*>*>y)  B  f(h>*)  a  F(“>y) A  t(s0(x)  4*u.Az  «§0(*)) 

V  (So(x)  w  u  A  -1  3  a  pred(z,2))3 

=  f(h>*)  a  f(h>z)  a  US^x)  4*  H  a  1  w  §i(*)) 

V  (^(x)  »  u  A  -1  3  z  pred(z,jr))]. 

(Note  that  -|3  z  pred(z,y)  holds  for  y  f  Ng  iff  y  *  e).  Now  let  u  £  Ng  and 
consider  the  structure  SI(u)  ■  (D^P^P^),  where 

D  “  [x  :  F(u,x)}, 

Pq(x)  "  y  iff  GQ(u,x,y), 

P:(x)  -  y  iff  G^(u,x,y) . 

If  u  »  £,  then  3l(u)  is  ^  itself.  If  u  f  e,  say  u  *  \|f(e)  for  some  nontrivial 
term  ty,  then  8l(u)  is  a  generated  x-algebra  satisfying  the  axiom  3  x[x  «  iji(x)]. 
It  follows  that  every  generated  K-algebra  is  isomorphic  to  some  ?l(u),  u  ^  Ng. 
Let  E  be  any  sentence  in  the  language  L.  Using  standard  techniques  of  replace~ 
ment  of  atomic  formulas  by  formulas  and  relativization  of  quantifiers  (e.g.,  a 
formula  Sq(x)  «  ^  is  replaced  by  Gq(u,x,£),  a  quantifier  3  X  ...  is  replaced 
by  3  X[V  z[z  £  X  F(u,z)]  a  ...,  and  so  on),  we  can  effectively  obtain  a 
formula  E'(u)  such  that  E  is  true  in  5l(u)  if  and  only  if  E'(u)  holds  in  9tg. 
Since  every  element  of  K  is  isomorphic  to  some  $l(u),  it  follows  that  E  is  true 

o 

in  Kg  If  and  only  if  V  u  E'(u)  is  true  in  JRg.  But  WS(*Jlg)  is  decidable;  hence, 


I 
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Our  next  tuj:.  result  will  be  Chet  WS(KU)  is  decidable.  The  principal  tool* 
we  ahall  use  in  the  proof  of  this  are  the  generalized  products  of  Fererman  and 
Vaught  [12].  Since  their  reeulte  on  generalized  products  apply  only  to  elemen¬ 
tary  theories,  we  are  obliged  to  replace  WS^)  by  an  equivalent  elementary 
theory:  In  fact,  we  shall  correlate  with  each  structure  ||  a  structure  fj+  such 
that  WS(tl)  is  decidable  iff  ET($I+)  is  decidable. 

DEFINITION  5.10.  Let  tl  ■  (A,0  ,  ...,0  .,R  ,...,R  -  >  be  an  algebraic  structure, 

and  let  A+  be  the  set  of  all  finite  subsets  of  A.  Then 

!1  m  (A  U  A  , A, e ,0^  1  •  •  • , •  • » , ) 

where  each  0|  is  a  n^+l-ary  relation  such  that  0^(xo,...,xn  ,y)  iff 

Ci(V...,xn  )  “  y>  *nd  e(x,y)  holds  between  tiro  elements  x,  y  of  A  u  A  if 
*  + 

and  only  if  x  £  A,  y  £  A  ,  and  x  f  y. 

LEMMA  5.II.  Let  N  be  any  algebraic  structure.  We  can  effectively  correlate 

with  each  formula  F(x  ,  ...,x  ,,X  ,...,X  ,)  in  the  monadic  second-order 

— o  -m-i  — o  -n-l 

language  of  qa  formula  F'Cx^, •••>?„  j)  in  the  *l«»*ntery  language 

of  SI+  such  that,  for  any  xq,...,  x^,  yQ,  •••>  yn-1  <?  |#+|, 

F'(x  ,...,x  ,.y  .•••»y  .)  holds  in  tl+  if  and  only  if 
o  m-i  o  n-i 

(i)  xQ,...,xn_l  £  |«|, 

(ii)  €  l«|+, 

and 

(iii)  F(xo,...,xjn-1,yo,...,yn_l)  holds  in  «. 


24  July  1967 


67 


TM-738/035/00 


PROOF:  by  standard  techniques  of  eliminating  terms  in  favor  of  relation 
symbols,  replacement  of  atomic  formulas,  and  relativlzation  of  qualifiers. 


A  given  ungenerated  X-algebra  91  is  determined  up  to  isomorphism  by  any  of 
its  descriptors.  The  following  definition  and  lemma  provide  an  explicit  method 
for  the  construction  of  an  ungenerated  X-*lgebra  with  any  given  descriptor. 

Some  of  the  technical  features  of  this  construction  facilitate  a  later  argument 
involving  generalized  products. 


DEFINITION  $.12.  Let  U  be  any  subset  of  the  natural  numbers.  Then  5$(u)  is  the 
relational  structure  (B  (J  B' ,B,E,Tq,Tj >  where 

(i)  B  is  the  set  of  all  sequences  f  ■  (f(0),f(l), . . . )  such  that  f(l)  ■  0 

A  M 

except  for  one  1,  denoted  by  f,  and  f(f)  f  N2,  subject  to  the  restriction  that, 
if  f  >  0,  then  f(f)  c  {b}  *  Ng  only  if  f-1  c  U  and  f(f)  £  {a}  •  Ng  only  if 
f-1  $  U; 

(ii)  B*  is  the  set  of  all  sequences  f  ■  (f(0),f(l), ...)  such  that  f(l) 
is  a  finite  subset  of  Ng  for  each  i,  f(i)  t  <t>  for  at  most  finitely  many  1,  and 
for  each  i  and  w  f  Ng,  w  f  f(l)  only  if  the  sequence  g  such  that 

g(j)  -  0  if  J  +  i, 

-  w  if  j  -  i, 


is  a  member  of  B; 

(iii)  E(f,g)  holds  if  and  only  if  f  f  B,  g  £  B' ,  and  f(f)  €  g(f); 

(iv)  TQ(f,g)  is  defined  only  for  f,  g  £  B:  in  case 

A  4k  A 

f  >  0,  f-1  £  U,  and  f(f)  ■  e, 
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Chen  TQ(f,g)  holds  if  and  only  if 

n  a  a 

g  *  f-1  and  g(g)  -  e, 

and  in  all  ocher  cases,  TQ(f,g)  holds  if  and  only  if 

A  A  A  A 

g  ■  f  and  g(g)  *  f(f)a; 

(v)  T^(f,g)  is  defined  only  for  f,  g  £  B:  in  case 

n  A  a 

f  >  0,  f-1  ^  U,  and  f(f)  ■  e, 

Chen  T^(f,g)  holds  if  and  only  if 

«  A  A 

g  ■  f-1  and  g(g)  ■  e, 

and  in  all  ocher  cases,  T^(f,g)  holds  if  and  only  if 

g  -  f  and  g(g)  -  f(f)b. 

LEMMA.  5.13.  LeC  U  be  any  sec  of  naCural  numbers.  Then  Chere  exist,  an  un- 
generaCed  K-algebra  SI  such  Chat  Sl+  a  S3(u) ;  moreover,  U  is  a  descriptor  of  21* 

PROOF.  Let  8(U)  be  as  in  definition  5*12,  and  put  SI  ■  (B,Sq,S^>,  where  for 
each  f  €  B,  SQ(f)  is  the  unique  g  £  B  such  that  TQ(f,g),  and  is  defined 
analogously  from  T^.  The  verifications  that  Sq,  are  well-defined,  that 
SI+  a.  S(u),  and  that  U  is  a  descriptor  of  21  are  purely  routine. 

Figure  4  is  a  diagram  of  a  structure  3$(U)  where  U  ■  {0,3,...}.  Each  node 
corresponds  to  a  distinct  sequence  f  in  B,  and  the  value  of  this  sequence  at 
the  one  place  where  it  is  different  from  0  is  indicated  alongside. 

He  shall  briefly  summarize  the  definitions  and  theorems  concerning  gener¬ 
alized  products  which  are  required  for  the  proof  of  the  decidability  of 
ET(x^).  All  of  this  material  i,'  drawn  from  [12],  with  some  minor  changes. 


* 
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Figure  4.  Diagram  of  a  Structure  !B(U)  Where  U  ■  {0,3j***}‘ 


I 
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mostly  notational.  The  reader  should  have  little  difficulty  in  reconciling 
these  differences.  (The  principal  difference  is  our  use  of  monadic  second- 
order  theories  instead  of  the  somewhat  more  general  "subset  algebras.") 

Let  31^,  i  £  I,  be  a  set  of  relational  structures  of  the  same  similarity 
type,  Indexed  by  members  of  the  nonempty  set  I.  Let  6  be  any  relational  struc¬ 
ture  such  that  |6]  ■  I.  Let  F  be  a  formula  in  the  monadic  second-order  language 
of  6,  and  let  GQ,...,Gm  be  elementary  formulas  in  the  language  of  the  The 

sequence  £  ■  (F,Gq, . . .,Gm>  is  called  a  standard  acceptable  sequence  with  free 

variables  x  , . . . ,x_  if 
.  ....  — —  — o  — n 

(i)  The  free  variables  of  F  are  at  most  the  set  variables  X  ,...,X  ; 

(ii)  a  variable  occurs  free  in  some  G^  if  and  only  if  it  is  one  of 

V*'V 

Let  D  be  the  set  of  all  functions  f  :  I  — •  such  that  f(i)  £  |s/^| 

for  each  1  g  I.  A  standard  acceptable  sequence  £  ■  (F,Gq,  . .  .,G  )  with  one 

free  variable  x  defines  a  set  D'  £  D  if 
— o 

D'  ■  {f  :  F(XQ,...,Xm)  holds  in  6  (under  the  strong  interpretation)] 
where  for  J  ■  0, . . . ,m, 

Xj  ■  (i  :  i  £  I  and  Gj(f(i))  holds  in  81^  (under  the  strong  interpretation)} 

In  case  the  sequence  £  has  free  variables  xQ,...,xn,  n  >  0,  we  say  that  £ 
defines  a  n-ary  relation  on  D,  with  an  analogous  meaning.  Finally,  a  relativized 
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generalized  product  of  the  2/*^  with  respect  to  6  is  a  relational  structure 
<D',r  where 

(I)  D'  Is  defined  by  a  standard  acceptable  sequence  with  one  free  variable 

(II)  each  RJ >  J  <  p,  Is  obtained  by  restricting  a  relation  Rj  on  D  to  D* 
where  Rj  Is  defined  by  a  standard  acceptable  sequence. 

Thus,  each  series  of  standard  acceptable  sequences  Co*'*'*^  luc^  C0  ^as 
exactly  one  free  variable  defines  a  relativized  generalized  product  p(Jl,6). 

(In  this  notation,  31  denotes  the  entire  sequence  of  2J^,  i  £  I;  i.e.,  21  is  a 
function  with  domain  I  such  that  each  value  Is  a  structure  of  a  given  similarity 
type.)  If  a,  3  are  classes  of  relational  structures  (of  suitable  similarity 
types)  then  p(Q, g)  is  the  class  of  all  products  9(21,6)  where  6  £  g  and  for  each 
1  £  |®|,  9/^  £  a.  The  basic  theorem  on  generalized  products  (Theorem  3.1, 

[12]  states: 

Any  set  or  relation  definable  In  the  elementary  theory 
of  a  relativized  generalized  product  can  also  be  defined 
by  a  standard  acceptable  sequence;  moreover,  this  sequence 
can  be  effectively  obtained  from  the  defining  formula. 

We  shall  not  use  this  theorem  directly,  but  rather  the  following  consequence 
of  it  (see  Theorem  5  >6,  [12]): 

If  ET(q)  and  SS(g)  are  decidable,  then  so  is  ET(p(G,g))* 

THEOREM  2  14 •  ■-■et  3  be  the  class  of  all  structures  (u),<,U),  where  U  c  u>.  Then 

there  1  i  relativized  generalized  product  p  such  that  ptiJIg},*)  is  the  class  of 
all  B(U),  U  c  u). 
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PROOF.  We  must  exhibit  a  series  of  standard  acceptable  sequences  q  t  £g, 

C4  defining  the  product  p.  The  language  of  g  has  the  constant  predicates 
<  and  U,  and  in  the  language  of  (Jfg  ■  <Ng  U  N*,  Ng,  e,  Rq,  R^),  we  use  the  symbols 
N,  e,  Rq,  R  .  In  both  languages,  unsubscripted  variables  appearing  In  a  formula 
denote  any  variables  (of  the  appropriate  type)  which  do  not  occur  free  in  the 
formula.  The  letters  f,  g  denote  functions  from  u)  to  We  take 

6  ■  (u),C,U)  to  be  an  arbitrary  element  of  g,  and  we  let  $(U)  ■ 

(B  U  B',B,E,To,T^)  be  as  in  Definition  5. 12.  Our  definitions  of  the  sequences 
C0*“'jC4  w111  be  given  in  such  a  way  that  only  a  straightforward  check  against 
Definition  5. 12  (which  we  omit)  is  required  to  verify  that  they  do,  in  fact, 
define  the  universe  and  relations  of  B(U). 

Let 

F1(Xo,X1,Xg,X3)  =  V  x[x  $  XQ  -  x  <=  Xx] 

A  3  x[x  €  Xo  A  V  jrtz  €  X0  -  x  *$[]] 

A  V  X  v  f  50  A  1!  <  5  A  ^  3  <  *  A  *  <  x] 

(x  p  Xg  -1  u(^))  a  (x  c  -  u(^))]. 

Now  if 

Xq  -  {n  :  f(n)  $  Ng}, 

Xj  ■  (n  :  f(n)  -  0}, 

Xg  •  {n  :  f (n)  f  (a)  *  Ng}, 

X3  ■  {n  :  f(n)  c  {b}  *  Ng}, 
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then  F^(Xo,X^,Xg,X  )  holds  In  6  (under  the  strong  interpretation)  if  and  only  if  f  is  a 
member  of  B.  We  need  only  define  formulas  Gj  such  thac  X^  ■  {n  :  Gj(f(n))  holds  in 

G0(x0)  -  N(xq), 

Gl^-o^  5  n  -^-O^  A  ^  3  X  ®(x>x0), 

G2(xo)  s  S  5  3  zCS(x)  A  1  3  *te0(£>5)  V  R^x))  a  R0(x,£) 

A  Sal' (jr,xo)], 

where  Sal*  is  obtained  from  Sal  as  in  Lemma  5. 11,  and 

g3(x0)  =1x3  £[N(x)  Ail  £[R0(z,x)  V  R^Zjx)  ]  A  R^x,^) 

A  Sal'(jr,xo)]. 

These  formulas  satisfy  the  required  condition,  and  hence,  ^  ■  (F^G^G^Gg^) 
is  a  standard  acceptable  sequence  defining  B. 

The  sequence  must  define  BUB',  the  domain  of  S(U).  Let 

Fo^-1,-4'-5,^6^  b  3  £  v  £[x  <  £  -  l  f  A  V  x[x  £  X^) 

A  V  x  v  j;Cx  <  x  A  -1  3  s[j[  <  *  A  z  <  x]] 

-(x  PXjAn  U(jr))  V  (x  €  %  A  u(x))]. 

If  now  X^  is  as  before,  and 

X^  ■  [n  :  f(n)  is  a  finite  subset  of  Ng} 

X^  -  In  :  f(n)  c  ((a)  •  Ng)  U  U}}, 

X6  -  {n  :  f(n)  c  ( {b )  *  Ng)  U  ie}}. 


24  July  1967 


74 


TM-738/035/00 


then  Fo(Xj^X^,X^,Xg)  hold*  In  ®  If  and  only  if  f  f  B'.  Thu*,  we  let 

V-o^  s“,-^o)' 

^(Jio)  *  "»  £(*<,)  A  v  *£*(*'*<,)  -  1  3  £[Rq(£^)  v  v  G2(x)], 

h  -1  N(5o)  A  V  x[e(x,xo)  -nl  £[*0(£>*)  V  R^x)]  V  C^x)], 

and  find  that 

Cq  "  <*0  v  ^c0,...,g6> 

la  a  standard  acceptable  sequence  defining  BUB*. 

The  sequence  ^  should  define  the  relation  E  of  8(u).  Let 

f2(X0)  5  ^  2£Cx  cXq]; 

then  if 


XQ  -  In  :  f(n)  $  g(n)}, 

we  find  that,  for  f,  g  f  B  U  B',  F2(Xq)  ^oldx  in  ®  and  on‘*,y  **  E(f,g).  Fut 

S  e^5o»5i)* 

Then  ^  “  <F2^Gy)  is  *  standard  acceptable  sequence,  and  E  is  the  restriction 
to  B  U  B'  of  the  relation  defined  by  it. 


)  =  3  x  3  y[x  e  X,  A  1  £  Xx  A  {(3  x'[x'  <  x 
A”i3  z[x'<  £  A  S  <  x]  A  U(x')  A  X  f  Xg] 
A  Jr  <  X  A  I  £Cl  <  i  A  £  <  X]  A  U  e  Jj) 
A  (-1  3  x'  [x'  <  x  A  -1  3  z[x'  <  z  A  z  <  x] 
A  U(x'  )  A  x  f  Xg]  A  J[  «  x  A  J[  P  Xj^)}]; 


Let 


0 
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then  If 

Xq  -  In  :  f(n)  e  NgJ, 

Xx  -  in  :  g(n)  £  Ng}, 

X2  -  [n  :  f(n)  -  e), 

X3  -  in  :  g(n)  -  e  ], 

X^  -  £n  :  g(n)  -  f(n)a}, 

we  have  that  for  f,  g^BUB1,  F(Xo'Xl,X2,X3,X4^  holds  in  6  iff  TQ(f,g).  Thus, 
we  put 

03(5,,)  •  Six,) 

C9<*1>  *  ®8<*i) 

al0^  -  A  *’  3  v 

Gn(ii)  s 

G12(Jo'5l>  s 

and  have  that  ^  ■  (F^GgjG^G^G^G^g)  is  a  8tan<*ar<*  acceptable  sequence  and 
the  restriction  to  B  U  B'  of  the  relation  defined  by  it  coincides  with  Tq. 

The  sequence  defining  an  extension  of  is  similar  to  £  ,  and  is 
obtained  from  the  latter  by  making  suitable  minor  modifications  to  the  formulas 
and  .  This  completes  the  proof  of  Theorem  5.14. 

COROLLARY  5.15.  WS(Xu)  is  decidable. 

PROOF.  The  decidability  of  WS(Ku)  is  equivalent  to  the  decidability  of  ET(K+). 
Ijy  YIieoreSf  5.14  and  the  results  of  Feferman  and  Vaught,  this,  in  turn,  follows 
from  the  decidability  of  WS({Jl2),  which  we  know  from  3.8  and  5 >11,  and  of  ss(&)> 
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where  g  Is  the  class  of  all  <gu,<,U),  U  c  id.  In  [2],  Buchl  established  the 
decidability  of  SS((uj,<>)»  Now  a  sentence  F  Is  in  SS'g)  if  and  only  if  the 
sentence  V  X  F'(x),  where  F'(X)  is  obtained  from  F  by  replacing  each  occurence 
of  the  unary  predicate  symbol  U  by  the  set  variable  X,  is  in  SS((u>,<)).  Thus, 
SS(g)  is  decidable,  and  hence,  so  is  WS(XU). 

COROLLARY  5. 16.  The  weak  second-order  theory  of  simple  X-algebras,  WS(x_),  is 
decidable. 

PROOF:  by  5.9  and  5.I5. 

Cardinal  sums  were  included  by  Feferman  and  Vaught  among  their  examples 

of  relativized  generalized  products.  We  cannot  directly  use  this  result  in 

a  proof  of  the  decidability  of  WS(x),  for  the  class  x  is  not  the  same  as  the 

class  of  cardinal  sums  of  members  of  X+«  Nevertheless,  we  can  still  use 

8 

generalized  products  to  prove 
THEOREM  $.17.  ws(x)  is  decidable. 

PROOF.  By  the  Lowenheim-Skolem  theorem,  as  it  applies  to  weak  second-order 
theories,  we  may  restrict  the  class  X  to  contain  only  countable  cardinal  sums 
of  members  of  X  •  Let  g  be  the  class  of  all  structures  (U,<)  where  0  f  U  c  u) 

B 

and  <  is  the  order  relation  on  natural  numbers  restricted  to  U.  The  decidability 
of  SS(g)  follows  immediately  from  that  of  SS  ( (u>,<)) •  Let  6  ■  (u,<)  be  a 
member  of  g,  let  ■  <A^,S^,S^>  £  Xg  for  each  i  £  U,  and  let  S  be  the 
cardinal  sum  of  the  We  wish  to  define  a  relativized  generalized  product 

p  such  that  p(8l+,®)  a  93+ ;  actually,  we  shall  only  give  an  informal  description 


24  July  1967 


77 


TM-738/035/OO 


of  p(tl,6),  for  the  reader  who  has  studied  either  [12]  or  the  proof  of  5.14 
should  have  little  difficulty  in  supplying  the  necessary  standard  acceptable 
sequences,  f,  g  denote  functions  with  domain  U  such  that  for  each  i,  f(i), 
g(i)  €  |H(1^+|. 

The  universe  of  p(5l+, )  is  B  u  B',  where 

(i  ) 

(i)  f  £  B  iff  for  some  iQ  £  U,  f(iQ)  €  A  °,  while  for  all  i  t  i Q> 
f(i)  “  <t>\ 

(ii)  f  £  B'  iff  for  every  i  £  U,  f(i)  is  a  finite  subset  of  A^,  and 
for  only  finitely  many  i  do  we  have  f(i)  j*  0. 

The  relations  of  ip(?l+,S)  are 

(i)  B, 

(ii)  e(f,g),  which  holds  iff  f  £  B,  g  f  B',  and  for  every  i  f  D,  either 
f(i)  «  0,  or  f(i)  g  8(i)> 

(iii)  RQ(f,g),  which  hole  iff  f,  g  £  B  and  for  every  i  f  U,  either 

f(i)  “  g(i)  ■  <t>,  or  R^(f(i),g(i)), 

/ 

(iv)  R^(f,g),  analogous  to  Rq. 

The  product  p,  thus  described,  establishes  the  decidability  of  ET(K+),  and 
hence  of  WS(K). 

A  similar  proof  of  5*1-7  which  does  not  use  the  Lowenheim-Skolem  theorem 
can  be  given.  However,  this  proof  uses  the  most  general  form  of  the  generalized 
products,  wherein  the  relational  structure  over  the  index  set  is  replaced  by  a 
subset  algebra. 
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It  Is  not  difficult  to  show  that  Theorem  5.17  cannot  be  further  improved; 
in  the  aanse  that  neither  of  the  Axioms  II- 1,  II-2  can  be  omitted  while 
retaining  decidability. 

COROLLARY  5.18.  Let  7,  7m>  and  for  k  <  uo  be  the  subclaaa  of  £  cone ie ting 
of,  respectively,  the  free  algebras,  the  free  algebras  with  infinitely  many 
generators,  and  the  free  algebras  with  k  generators.  Than  each  of  WS(y), 

WS(y  t),  W8(;k),  k  <  a,  and  WS(£)  la  decidable. 

PROOF:  Each  of  these  subtheories  of  WS(x)  is  finitely  (semantically) 
axloaatisable. 

As  remarked  at  the  end  of  Section  4,  M.O.  Rabin  has  recently  found 

a  proof  of  the  decidability  of  SS(!R  )  for  every  finite  p.  The  constructions 

P 

and  proofs  of  this  section  require  only  minor  modifications  to  handle  the 
strong  second-order  case.  The  proof  of  5.17;  least,  becomes  simpler,  and 
no  use  of  the  Lowenhelm-Skolem  theorem  is  required.  Thus,  with  Rabin's  result 
as  a  starting  point,  we  can  establish  the  decidability  of  SS(x)  and  SS(£). 
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